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13.  ABSTRACT 


This  report  summarizes  the  major  results  and  conclusions  of  a  program  of 
research  concerned  primarily  with  the  relationship  of  cognitive  abilities  to 
learning.  The  major  purpose  of  this  research  was  to  develop  theorems  of  instruc¬ 
tion  related  to  the  interaction  of  task  variables  and  individual  difference 
variables,  and  to  develop  them  in  a  manner  relevant  to  the  instructional  designer's 
task.  ( U ) 


The  studies 
ing  of  concepts  and 
systems.  "  The  goal 
from  simple  concept 
and  rules,  to  a  set 
this  knowledge  into 


focus  on  the  relationship  of  cognitive  abilities  to  the  leam- 
rules  and  to  the  learning  of  an  imaginary  science  of  Xenograde 
was  to  establish  a  theoretical  and  methodological  continuum 
learning  through  the  learning  of  a  complex  system  of  concepts 
of  instructional  design  procedures  which  permit  transfer  of 
practice.  (U) 


On  the  basis  of  the  studies,  a  model  for  research  in  this  area  is  recom- 
mended,  cognitive  processes  relevant  for  concept  and  rule  learning  are  defined, 
a  hypothesis  construction  model  of  simple  concept  learning  is  outlined ,  along 
with  proposed  theoretical  considerations  for  more  complex  concept  learning,  and 
specific  recommendations  for  instructional  design  utilizing  differences  in  intel¬ 
lectual  abilities  are  made.  (U) 
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Tii*  objectives  of  tnis  program  of  research  w*re  iwuritN  In  the 
abstract  of  tna  initiating  proposal,  uulnittod  October  12,  1967 1 

Too  psycoological  investigation  of  Huron  learning  has  been 
1 ini tad  in  at  least  two  directions)  first,  the  class  of  tasks 
studied  has  been  too  narrow  and  proscribed  to  permit  ready  gener¬ 
alization  to  educational  settings,  and  seconu,  behavioral  psycholo¬ 
gists  have  failed  to  integrate  the  data  from  the  psydwmetric  studies 
of  individual  differences  in  learning  and  thinking  into  their  theories. 
Recent  developments  in  cognitive  psychology  promise  to  narrow  the 
gap  between  the  study  of  learning  and  the  study  of  individual  dif¬ 
ferences.  The  new  emphasis  on  individualized  instruction  in  this 
country,  along  with  the  introduction  of  computer  technology  into 
the  educational  process,  provides  the  opportunity  to  narrow  the  gap 
between  the  study  of  human  learning  in  the  laboratory  and  in  practical 
training  and  educational  problems. 

Questions  of  sequencing  in  a  hierarchical  task  will  be  studied, 
using  an  imaginary  science  task  which  parallels  the  hierarchical 
structure  of  concept  and  rule  learning  in  science  and  mathematics. 

A  version  of  this  task  which  employs  an  inductive  or  discovery 
approach  will  also  be  developed  and  investigated.  The  interaction 
of  cognitive  and  other  traits  with  different  degrees  of  learner 
control  and  with  expository  versus  inductive  presentation  will  be 
explored.  The  interactions  of  cognitive  abilities  with  treatment 
conditions  in  learning  concepts  and  rules  will  be  studied  using 
laboratory  concept  tasks  both  on  and  off  the  computer  as  appropriate. 
This  set  of  activities  provides  the  link  between  learning  theory  and 
individual  differences  on  the  one  hand  and  between  instructional 
theory  and  instructional  design  on  the  other. 

In  the  original  proposal,  stress  was  placed  on  the  need  that 
psychological  research  be  relevant  to  the  "state  of  the  art  in  instructional 
design.  The  instructional  design  model  current  then,  developed  and  used  by 
the  Computer- Assisted  Instruction  (CAI)  Laboratory  for  contract  curriculum 
development  funded  by  publishers,  industry,  and  government,  was  described 
in  the  original  proposal.  This  model  represents  a  pragmatically  oriented 
approach  to  instructional  design  and  development,  having  the  flavor  of 
systems  analysis.  It  permits  quality  control  and  management  of  curriculum 
development.  The  need  to  base  the  instructional  designer’s  decisions  on 
empirically  validated,  theoretical  propositions  rather  than  solely  on  the 
basis  of  intuition  and  trial  and  error  was  stressed.  A  long  range  goal  of 
this  research  program  (which  was  originally  conceived  to  extend  more  than 
two  years)  was  to  develop  those  aspects  of  a  theory  of  instruction  related 
to  the  interaction  between  task  variables  and  individual  difference  varia¬ 
bles  and  to  develop  them  in  a  manner  relevant  to  the  instructional  designer's 
task. 
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A  con  limn*  mu  conceived  for  (Me  proor  •*  vhvrvln  Um  int'rw  m  mi 
diiiijn  modal  Mrlitd  tin  amt  applied  ««ur«on  and  tit*  actual  u»Hi 

an  inatcoctlonal  ocaijnar  had  to  per  tom,  the  approx  u*»t#  aaquanco  of  tne 
taaka,  and  their  Interrelationship* .  Thla  nodel  was  expected  to  evolve  fro* 
research  conducted  on  this  project  anu  on  other  tore  apjdiea  projects  In  tne 
CM  Laboratory.  The  retro  Male  o,*l  of  th>  continuum  was  markon  by  the  use  of 
laboratory  taaka  fan! liar  to  tne  experimental  ,iar*cholo9»at.  Yolo  allowed  tno 
research  to  ue  anchored  at  ono  end  a.  leaat  with  relevant  jortiona  of  tno  groat 
body  of  data,  Methodology,  and  theory  In  human  concept  and  rule  learning,  anu 
lluited  forma  of  problem  solving. 

Zn  an  attempt  to  bridge  applied  instructional  aosign  activities  and 
concept  learning  research,  a  CAI  program  was  developed  and  ovolvec  to  teach 
‘The  Imaginary  Science  of  Xenograde  Sy3teris.  7. us  learning  task  ties  into 

the  instructional  design  .touel  by  virtue  of  its  dosign.  It  was  designed  using 
the  steps  and  producing  each  of  the  products  prescribed  by  the  ..odel.  In  *>ar- 
ticular,  the  task  has  a  hierarchical  structure  wuerein  each  roue  of  the  hierarchy 
is  a  performance  objective  as  well  as  a  concept  or  rule.  Learning  the  rule 
could  hopefully  be  related  to  findings  in  the  more  usual  concept  learning  studies. 
The  Xenograde  task,  however,  also  permitted  empirical  study  of  sequencing,  in¬ 
dividualizing  techniques,  and  other  problems  known  to  be  of  primary  concern  to 
the  instructional  designer. 

Research  studies  conducted  under  this  contract  thus  can  be  classified 
under  either  the  use  of  the  Xenograde  task  or  the  use  of  more  conventional 
laboratory  tasks.  A  third  category  is  the  instructional  design  model,  its 
evaluation,  and  the  extent  to  which  the  research  studies  influenced  it. 

The  purpose  of  this  report  is  to  summarize  the  research  and  other 
activities  conducted  under  this  contract  and  to  evaluate  the  extent  to  which 
the  strategy  of  bridging  between  applied  and  basic  concerns  was  successful. 


NOTE. — A  summary  of  the  research  studies  and  other  activities  relevant  to  the 
objectives  of  this  research  program  is  found  in  Table  1.  The  table  is  broken 
into  Categories  I,  II,  and  III,  vnich  represent  (in  the  order  of  II,  I,  III) 
the  continuum  described  above.  These  headings  refer  to;  (I)  research  using 
the  Xenograde  task,  and  (II)  instructional  design  auu  CAI.  Category  III  sum¬ 
marizes  concept  research  and  otner  laboratory  tasks .  These  three  categories, 
with  their  roman  numerals,  also  designate  the  three  main  divisions  of  this 
report.  An  evaluation  Chapter  follows  Section  III. 
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SECTION 


I 


STUDIES  RELATED  TO  THE  USE  OP  THE  XtiJOCRADe  PROGRAM 


Aptitude  Interactions  with  Expository  or  Dieoover0  Treatments 

Contrary  to  over-optimistic  hopes  about  the  ease  of  conducting 
studies  of  human  learning  using  a  real-time  CAI  syjtem,  the  problem  of 
obtaining  clean  data  was  enormous.  Loss  of  data  due  to  program  and  hardware 
bugs,  and  proctor  and  operator  error,  are  added  to  the  problem';  of  subject 
attrition  and  clerical  error  whicn  plague  the  researener.  Tne  complexity  of 
program  development  and  data  analysis,  using  the  early  CAI  languages  and  systems, 
sometimes  added  weeks  to  the  time  required  to  complete  studies  instead  of 
facilitating  data  collection.  Those  early  problems  made  it  necessary  to  repeat 
every  Xenograde  study  at  least  once,  except  these  of  Merrill  (1970)  and  Bunder - 
son  and  Hansen  (1971) . 

As  programs  and  procedures  became  better  and  more  familiar,  these 
problems  were  reduced,  and  some  of  the  early  promise  of  CAI  was  realized.  The 
use  of  the  1500  APL  system  greatly  alleviated  the  programming  and  data  collec¬ 
tion  problem  so  that  at  the  end  of  the  project,  studies  were  sometimes  run  with 
great  speed  and  rapid  collection,  sorting,  ana  data  analysis. 

The  first  Xenograde  study  listed  dealt  with  a  simulated  version  of 
Xenograde  in  which  students  input  parameter  values  of  their  own  choosing  and 
studied  the  resulting  Xenograde  display.  This  was  the  only  early  Xenograde 
study  that  was  never  replicated.  Such  learner-directed  manipulation  of  the 
parameters  of  a  simulation  enables  students  to  discover'1  for  themselves  the 
relationships  produced  by  the  simulation  model.  The  original  pilot  study  made 
it  clear,  however,  that  simulation  is  inappropriate  as  a  means  of  discovering 
concepts  and  rules  for  the  first  time  in  unfamiliar  material,  at  least  for 
subjects  drawn  from  education  courses.  Simulation  may  be  advantageous  for 
integrating  concepts  and  rules  learned  previously,  testing  in  a  more  complex 
and  life-like  situation,  demonstrating  complex  interactions,  or  generating 
example  stimuli  for  expository  instruction.  Ti.e  implications  of  this  pilot 
study  and  other  Xenograde  studies  were  presentee  at  a  conference  on  computers 
in  physics  and  mathematics  education  in  August  of  1970  (Bunderson,  1971) . 

Another  problem  with  this  initial  simulation  was  its  inordinately 
slow  response  time  due  to  the  clumsy  calculation  algorithm  using  fixed  point 
arithmetic  in  the  counters  of  the  Coursevriter  II  language.  Further  studies 
using  simulation  models  to  drive  Xenograde  displays  v/ere  planned,  and  to  this 
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*na,  «  function  (Mu  «t  al.  1^01  *no  *  Mi  »( 

plot  functions  (ilwoton  ©t  «!.,  19 >0)  (or  producin';  ^rnpniesi  di*.  Uys  on 
Ov#  cathodo  r«y  tub*  of  tbs  Ib»:  1500  iyit«  *<?r*  developed  U  Mi  not  possi¬ 
ble  to  conduct  such  studies  before  the  cm  of  this  contract,  but  the  functions, 
in  particular  the  algebraic  function,  nave  prove*  very  valuable  awi  iuv»  been 
disseminated  aeon g  users  of  13  i  1500  equipment . 

A  series  of  four  studies  was  co.tducted  Mien  exam  new  tae  possible 
interactions  of  genoral  reasoning,  inductive  reaooning,  and  associative  re-aory 
with  rula-exaaple  (rule.)  or  expository)  vs.  exaople  only  (discovery)  instruc¬ 
tional  treatments.  Tite  first  two  studies  were  fraught  with  numerous  problems 
ann  were  considered  pilot  studios  which  ltd  to  iafortnnt  revisions  in  tho 
Xenograde  program  and  to  hypothases  that  were  ultinately  tested  in  later  studios. 
The  last  two  replications  aro  reported  in  Technical  Report  ho.  3.  Tho  first 
of  these  two  pilot  studios  led  to  abandoning  tho  group  w.iicn  used  simulation 
with  no  rules  or  oxamplts. 

The  second  pilot  study  used  the  rulog  vs.  example -only  treatments , 
and  it  produced  results  taiich  were  quite  influential,  botn  directly  and  indirectly 
on  later  studies.  In  this  study,  59  students  from  science  education  classes  at 
The  University  of  Texas  at  Austin  participated,  and  51  completed  all  cognitive 
tests  and  the  Xenog  program.  The  battery  of  cognitive  tests  was  selected  from 
the  Kit  of  Reference  Tests  for  Cognitive  Factors  (French,  Ekstron,  &  Price, 

1963)  and  included  two  tests  for  each  of  the  factors  of  Induction,  Associative 
Memory,  and  General  Reasoning.  The  Induction  and  Reasoning  factors  collapsed 
into  one  reasoning  factor. 

On  the  basis  of  this  pilot  worx,  several  conclusions  were  reached. 

First,  the  discovery  group  required  more  examples  to  learn  the  science,  but 
there  were  no  differences  between  the  groups  on  a  posttest  a  retention  test, 
or  a  transfer  test.  Second,  memory  ability  was  found  to  be  highly  related  to 
performance  when  statements  of  the  rules  were  given,  but  this  was  not  found 
when  subjects  were  required  to  infer  their  own  rules.  This  interaction  was 
ciisordinal;  i.e.,  the  regression  lines  on  memory  for  the  two  treatment  groups 
crossed  not  far  from  the  mean  on  memory  score.  In  addition  to  these  results, 
the  pilot  study  also  revealed  that  the  amount  of  tine  required  to  learn  the 
task  was  excessive  and  that  several  of  the  rules  were  too  difficult.  Conse¬ 
quently,  the  task  was  revised.  A  new  task  analysis  proceuure  was  used  for 
the  first  time.  The  basic  structure  of  tue  science  was  maintained,  but  several 
of  the  laws  wnic’n  governed  the  relationships  of  the  system  were  changed.  The 
verbal  statements  of  the  rules  were  simplified  and  the  examples  were  selected 
so  that  only  integer  values,  rather  than  decimal  fractions,  were  shown .  hypothe¬ 
ses  about  the  disordinal  interactions  with  memory  were  generated  which  ulti¬ 
mately  led  to  a  study  soon  to  be  published  (Bunderson  £  Hansen,  1571) . 

A  second  study  was  conducted  to  test  the  feasibility  of  the  revised 
version  of  the  Xenograde  program.  In  this  study,  no  subjects  from  science 
education  classes  at  The  University  of  Texas  at  Austin  were  run  under  the  same 
design  as  described  above.  Unfortunately,  usable  data  were  obtained  on  only  30 
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tho  ditvowry  ,roo*  was  m^nly  rcUtsd  (AVtiMty,  to  r«4*ofti«*j  **»* 

W4«  not  the  cue  with  cm  jroup  **»icn  u*a  prooonto*.  with  iUIawau  of  tte  »«♦!«*. 
The  inverse  relationship  Urtweon  ,  wory  end  forma  ice  in  Us  oiacowry  acmuj  , 
which  wss  found  in  the  study  conducted  before  revision,  mss  not  repliceted. 
Instead,  men or/  fit  found  to  facilitate  performance  in  the  discovery  9f«wj,  4* 
irvuicetou  by  number  of  examples,  rethar  tnen  hinder  It.  This  indicated  Uvh 
revision  had  somehow  substantially  altered  the  rote  nf  eenory. 

In  the  final  study  cf  thit  series.  S3  students  from  science  evocation 
classes  at  T.m  University  of  Texas  at  Austin  completed  all  fawtor  testa,  thi 
hunog  program,  and  retention  and  transfer  tacts.  Vais  study  was  tlw  same  in  all 
respects  to  tlto  one  just  d^ccribod,  but  it  was  regarded  aa  a  replication  bccauae 
of  tha  small  N  in  tne  previous  study,  ‘."he  reunite  wure  a  replication  of  tix>ne 
in  tha  previous  study.  Tito  discovery  group  required  a  greater  nuioor  of  oxauplos 
to  learn  the  science,  and  the  nutter  of  examples  r on. tied  was  found  to  be  highly 
related  to  reasoning  ability,  The  positive  relation  of  .  memory  to  porfoinanco 
was  again  observeu.  Tnrao  results  anu  their  implications  to  instructional 
design  were  reported  in  papers  presented  at  the  annual  moating  of  tne  American 
educational  research  Association  in  Us-;  Zhigalos  (Dunuarson,  1069a)  and  at  tho 
annual  meeting  of  tho  American  Psychological  Association  in  Washington.  d.C. 
(□under son,  1969L) . 

The  curious  reversal  in  regression  slopes  for  memory  before  and  after 
revision  led  to  another  study.  Tnis  reversal  occurred  only  in  tne  discovery 
group.  Before  revision,  the  slope  of  tne  regression  line  was  positive  in  this 
group,  showing  that  subjects  nigh  on  memory  required  more  examples  to  learn 
(i.e.,  learned  less  efficiently).  Following  revision,  the  reverse  was  true: 
subjects  high  on  memory  required  fewer  examples  to  learn.  Two  variables  which 
were  changed  in  the  course  of  revision  were  the  availability  of  past  instances 
(before  revision,  subjects  could  record  previous  instances  on  a  worksheet)  anu 
complexity  of  the  displays  (irrelevant  information  was  reduced  during  revision) . 
Using  the  discovery  treatment  only,  these  t/o  variables  were  i-ianipula ted  in  a 
2x2  factorial  design  by  reintroducing  irrelevant  information  into  the  example 
displays  to  produce  complexity  and  by  manipulating  availability  through  the 
presence  or  absence  of  a  worksheet  for  recording  examples. 

This  study  peraaps  comes  closer  to  cross -validating  results  between 
the  Xenogracie  task  and  the  concept  learning  studies  than  any  conducted  during 
this  program.  The  facilitative  effects  of  memory  aptitude  on  number  of  ex¬ 
amples  for  learning  tuie  revised  Xenoyrade  task  hau  its  counterpart  in  number  - 
of-trials  for  learning  concepts  in  studies  by  Blaine,  Dunham,  and  Pyle  (196<J) 
and  Blaine  and  Dunham  (1970)  .  in  a  study  by  Wickiegren  ana  Owner:  (1962) ,  how¬ 
ever,  subjects  were  allowed  different  sizes  of  external  memory,  that  is,  notes 
they  could  write  about  previous  instances.  In  this  study,  greater  'external 
memory"  led  to  poorer  performances,  corresponding  co  the  positive  regression  of 
number  of  examples  on  memory  found  before  revision  in  Xenoyrade,  w.,en  a  record 
of  previous  examples  was  kept. 
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TtM  ruony  relations  Up  o.'  Saaaonln-j  Ability  to  forfotmneo  »n  team* 
ing  xenogrsde  woo  the  subject  of  thi  dissertation  study  wy  -err  ill  (lv?0.  tv* 
Hypothesized  that  ttie  reuontni  factor*  rcpceseniMl  facility  in  certain  mfotiu 
tlon  process In-j  Mills  Milch  enabled  subject*  high  cn  u>M  ability  to  focus  w»r« 
rapidly  end  accurately  on  the  relevant  aspects  of  eaanple  only  display*. 

Previous  \anog  studies  in  this  series  .tad  amen  that  the  intro *uctt  n 
of  rules  reduced  the  apparent  contribution  of  Rassonlng  Abilities  to  nothing. 

An  instructional  designer  aay  still  wisn  to  use  *  uiecovery  •«?».<•  yet  a. til 
doslro  to  reduce  tne  difficulty  oncour.terou  uy  subjects  low  on  heaeonii vj  Ability 
■arrill  hypothosized  List  the  presentation  of  .xrfoiosncj  objectives  would  in¬ 
troduce  a  focusing  uffect  whicn  would  reduce  tlw  slope  of  the  regression  of 
performs nee  on  Heaaoaing  Ability,  m  effect,  the  instructional  variable  *»  uld 
substitute  an  external  focusing  affect  for  tliu  focuci:ig  generated  by  euojecte 
high  on  Reasoning  Ability. 

Subjects  were  drawn  from  introductory  educational  psyc.ology  courses 
at  The  University  of  Texas  at  Austin,  and  a  total  of  131  completed  all  phases 
of  the  study.  Both  tne  availability  of  rules  And  of  objectives  wore  anipu- 
lsted  independently.  It  was  found  that  objective:-  did  significantly  r--.uco 
the  number  of  examples  requires  to  learn  tho  task.  Tula  effect  was  not  as 
strong  as  the  facilitativo  uffect  of  using  rules.  Ti.is  significant  reduction 
in  number  of  examples  was  no  stronger  for  subjects  low  in  -loasonin-j  tiian  for 
tnose  high  on  this  ability,  for  test -iter. -latency,  however,  subjects  low  on 
Reasoning  profited  from  the  availability  of  objectives  more  than  their  briq.itor 
fellows  did  (who,  it  must  be  added,  had  less  to  gain) . 

Performance  objective.*  are  one  of  the  .iost  important  products  of 
the  instructional  designer's  art.  .  ierrill's  study,  taken  as  a  wholo,  s..oved 
that  as  an  instructional  variable,  objectives  uave  orienting  and  organizing 
effects  which  dispose  students  to  attend  to,  process,  and  structure  relovant 
information  in  accordance  with  the  given  objectives.  This  facilitating  effect 
is  especially  helpful  to  students  lower  on  Reasoning  Ability. 
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Wnile  aptitude  x  treatment  interactions  were  the  major  concern  of 
these  studies,  it  is  interesting  to  note  what  the  results  have  to  say  about 
the  discovery-learning  hypothesis,  vis.,  that  learning  by  discovery  leads  to 
greater  retention  or  transfer.  Retention  and  transfer  measures  were  taxen 
in  each  Renograde  study.  The  transfer  measure  required  subjects  to  infer 
several  totally  new  rules,  given  new  examples — a  process  presumably  similar 
to  the  process  they  practiced  during  learning — but  in  no  case  was  the  dis¬ 
covery  learning  nypothesis  supported.  There  was  either  no  difference  between 
the  two  groups  or  a  difference  in  favor  of  the  rule -example  group.  This  was 
true  even  when  the  example -only  group  had  the  advantage  of  objectives  to 
study.  Contrary  to  most  studies  involving  uiscovery  learning,  moth  groups 
v/ere  brought  to  tne  .sane  criterion  on  the  posttest  by  means  of  individualized 
branching  in  the  CAI  program.  Vais  resulted  in  more  time  and  in  the  exposure 
to  significantly  more  examples  by  the  discovery  group  but  no  greater  and,  at 
times,  inferior  performance  on  retention  and  transfer.  Students  lower  on 
reasoning  and  memory  abilities  had  considerably  more  difficulty  with  the 
discovery  treatment  than  with  the  expository  presentation. 

Those  who  favor  the  discovery  hypothesis  may  argue  with  our  opera¬ 
tional  definition  of  discovery  or  with  tne  pernaps  unusual  motivational 
aspects  of  the  Renograde  task.  Tnis  may  not  correspond  to  their  definition 
of  discovery.  Until  someone  is  able  to  define  better  what  is  meant  by  dis 
covery  and  to  locate  the  source  of  any  supposed  auvantage,  the  instructional 
uesigner  must  be  wary  of  abandoning  tne  powerfully  effective  tool  of  well 
designeu  rule-example  presentations,  especially  if  he  is  dealing  with  popula¬ 
tions  neavy  on  the  lower  ends  of  the  ability  scales  used  in  these  studies. 

Another  approacn  _o  one  aspect  of  what  might  be  meant  by  discovery 
learning  is  through  investigation  of  learner  control  vs.  program  control  of 
instructional  sequence  and  otiier  variables.  Two  ..enogrude  studies  v/ere  con¬ 
ducted  to  investigate  the  effects  of  manipulating  the  sequence  of  rules  in 
the  Xenograde  learning  hierarchy.  In  both  of  these  studies,  only  the  rule- 
example  version  of  the  program  was  used.  In  the  first  study,  the  subjects 
were  118  students  from  introductory  educational  psychology  courses  at  The 
University  of  Texas  at  austin.  Since  only  49  completed  the  first  one,  it 
could  be  regarded  only  as  a  pilot  study.  It  was  replicated  with  minor  modi¬ 
fication,  using  17G  students  from  introductory  educational  psychology  courses, 
152  of  whom  completed  the  study. 

The  basic  rule-example  treatment  was  augmented  ny  a  representation 
of  the  hierarchy  of  rules  ’.Alien  constituted  the  Renograde  science.  Using  this 
hierarchy  as  the  basis  for  defining  alternate  sequences,  an  index  of  sequence 
was  defined,  as  follows.  The  index  was  1.0  wnen  the  sequence  was  in  the 
perfect  hierarchical  order  (that  is,  from  tne  lowest  order  rule  to  the 
highest) .  The  index  was  .5  -'uer.  an  essentially  random  sequence  of  rules  was 
taken;  anu  the  index  was  0.0  w.^en  the  reverse  sequence  (top  to  bottom  of  the 
hierarchy)  was  taken,  Philo  there  are  several  variations  among  treatment 
groups  used  in  this  study,  only  two  uasic  variations  are  reported  here.  One 
group  was  assigned  to  different  sequence  conditions  from  0.0  to  1.0  and  v/ere 
led  through  sequences  Ly  tne  CAI  program,  knottier  group  was  snown  the  repre¬ 
sentation  of  the  hierarchy,  and  each  student  v/as  allowed  to  c.ioose  his  own 
sequence. 
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Tlie  principal  findings  were  that  (except  for  the  0.0  sequence) 
students  in  the  learner-control  groups  die  oetter  wne n  they  chose  an  idiosyn¬ 
cratic  sequence  than  when  they  chose  the  1.0  sequence.  Motivational  effects 
were  postulated  to  be  at  the  root  of  tnis  finding.  On  the  other  hand,  stu¬ 
dents  assignee  randomly  to  different  sequences  did  poorly  when  the  sequence 
was  scrambled  and  did  progressively  better  as  the  sequence  approached  un 
index  of  1.0,  where  tney  did  significantly  better  than  students  wno  chose 
a  sequence  of  1.0. 

It  was  found  that  the  inductive  reasoning  factor  was  highly  related 
to  success  in  the  forced  group  wnen  the  sequence  was  scrambled  but  was  not 
related  when  it  approached  1.0. 

Mean  posttest  score  for  students  under  program  control  was  signifi¬ 
cantly  better  than  for  learner  control,  despite  negative  sequence  effects. 
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SECTION 


I  I 

INSTRUCTIONAL  DESIGN  AND  CAI  I.  PLICATIONS 


The  activities  in  this  section,  as  indicated  in  Tsblu  1,  relate 
to  computer-assisted  instruction  uore  generally  as  well  as  to  Instructional  Josi 
Previously  mentioned  were  the  technical  reports  listed  in  the  table  under 
II. B,  which  document  special-  Airposc  author  language  functions.  T.tese  ex¬ 
panded  considerably  the  answer  processing  display,  and  simulation  capabilities 
of  the  I&l  1S00  system. 

The  papers  listed  under  A  in  Table  2  are  pr  inaril y  concerned  with 
various  aspects  of  instructional  design  or  of  the  implications  of  altitude 
x  treatment  research  findings  to  instructional  dasign. 

The  instructional  dasign  model  provides  a  conceptual  structure  for 
classifying  the  products  of  instructional  daeign  in  a  manner  highly  related  to 
the  production  of  dociasentation  products  as  well  as  final  program  materials. 

The  intermediate  and  final  products  of  instructional  design  arc  outline^  in 
an  organized  scheme  and  are  discussed  by  Bunderwon  (1970a,  1971) . 

Technical  Report  No.  2  is  a  case  stuJy  of  instructional  design  an*: 
documentation  and  is  the  manual  for  the  Xenograde  program,  written  to  reveal 
the  various  design  products  prescribed  by  the  model.  Tne  manual  la  slanted 
toward  a  supposed  audience  of  researchers  rathsr  than  potential  educational 
users  due  to  the  nature  of  the  Xenograde  program.  Vnia  ><eco.>J  report  thus 
attempts  to  convey  some  of  the  rationale  benina  linking  instructional  research 
to  carefully  rationalized  and  carefully  documented  instructional  dasign  of  an 
experimental  task,  as  well  as  demonstrate  low  such  e  procedure  night  aid  In 
accomplishing  tho  ilnkago  of  research  to  relevance— of  science  to  engineering. 

The  papers  presented  at  tho  annual  meetings  of  the  7'wirican  Educa¬ 
tional  Research  Association  and  the  American  Psychological  Association 
(Bunder son,  1969a,  19C9L>,  1970  >)  concerned  the  relevance  of  aptituue  »  treat 
i«ent  interactions  to  instructional  design.  In  these  raisin' .  an  incrcasinj 
tone  of  skepticism  was  expressed  toward  tho  practical  value  of  disordinal 
interactions  between  treatments  and  aptltudas. 

The  nethonological  model  for  our  research  uuring  the  course  of  this 
project  came  to  reseetble  chat  aiscussed  by  Crorwach  and  Snow  (196.).  diven 
two  or  uore  separate  instructional  treatments,  tho  argument  goes,  it  ua/  be 
possible  to  find  one  or  more  aptitudes  (broadly  define.)  wnic.i  will  interact 
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such  that  students  low  on  tne  aeasurc  of  an  aptitude  *cy  oo  significantly 
better  in  one  of  the  groups  tnan  in  the  others,  wuile  for  students  nign  on 
that  aptitude,  die  reverse  may  oe  the  case.  This  interaction  is  o.  sorvcxl 
by  a  regression  analysis  w.iexein  the  regression  lines  of  performance  on 
aptitude,  calculated  separately  for  each  treatment,  cross  well  within  the 
range  of  the  aptitude  measure.  Such  a  pattern  of  regression  lines  is  temed 
a  d is ordinal  interaction. 

irfithodologically,  this  an>roach  nas  auc.i  to  be  ccrwendea  in  research 
studies.  It  is  asjused  by  Cronbacl;  and  Snow,  .towever,  that  results  of  this 
sort  can  lead  in  a  natural  aanner  to  improvements  in  instruction  ->y  assigning 
individuals  to  different  treatments  basad  on  tho ir  aptitude  scores.  Xt  is  this 
assumption  that  is  cuallangud  in  tiie  tnrve  pa><erc  cited  above. 

four  inter relatau  reasons  were  given  for  this  skepticism. 

(1)  The  rarity  of  useful  dieordinal  interaotune.  It  is  mote 
common  to  find  no  interaction  tJian  othorvisc.  tlien  Interactions  are 
found,  they  are  aora  likely  to  oe  oruinal  interactions  (regression 
lines  cross  outside  t!»  range  of  the  aptituoe  measures)  than  disoirdinal. 
>hen  they  are  found  to  be  ditordlnal,  they  often  prove  to  be  of  no  value 
relative  to  alternate  assigrewnt  since  the  point  of  intersection  of  thj 
regression  lines  follows  ss  closely  to  an  ono  of  the  aptitude  range  as 
to  proviao  no  hope  for  practical  Instructional  advantage. 

(2)  Dieordinal  into  taction*  my  not  be  sufficiently  roouot  under 
mVen  eemingly  minor  dt.vi.jc  i  in  t>*t  tool  or  fo fatal  ion.  t  (.vision  of  a 
task  is  the  instructional  designer's  uont  vo^crful  tool.  As  the  .tunder 
son  and  Hai.oer,  (1071)  stuey  indicates  revision  tay  produce  regression 
results  partially  predictable  oil  the  basis  of  an  understanding  of  tho 
variables  being  Manipulated,  out  those  Modifications  nay  produce  quite 
unexpected  and  possibly  more  imjortnnt  interactions  witii  otnur  aptitude  .. 

(J)  Ceiling  effect  on  Hie  mt.xdolojj  of  regression  couxlyeic. 
Successful  instructional  design  enablss  sll  subjects  to  reach  a  high 
performance  criterion,  dy  design,  there  is  alnost  no  variance  in  post* 
test  scores  (for  example) ,  allowing  the  variance  to  reap, oar  in  the 
number  of  examples  seen  or  in  tho  amount  of  iiice  taken.  Treatments 
in  which  thcra  is  sufficient  variance  remaining  in  posttevt  scores  to 
seek  ulsordinal  Interactions  nay  be  in  neeu  of  substantial  revision, 
vnich  introduces  t)*c  robustness  problem  (describe-  aoove)  and  vmIcK 
produces,  it  successful,  a  situation  wiore  regression  analyses  cannot 
be  applied,  at  least  not  on  the  posttest  score. 

(4)  Payoff  rotative  to  furtlter  instruct  unta  l  design  and  revision. 

Tne  payoff  attainable  through  alternate  treatment  assignment  based  on  a 
aisordinal  interaction  may  be  less  than  that  attainable  through  revision 
of  tits  single  best  treatment.  Xu  Instructional  design,  thor ;  is  probably 
no  factor  that  produces  .ore  improve:  >ent  for  uoro  students  than  tho  care* 
ful  ful  revision  of  a  program  -a  sod  on  detailed  feedback  of  student  rosponr.cn, 
attitudes,  and  ros.onso  tine*  aout  specific  oetails  of  an  instructional 
program. 
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It  mbs  proposed  in  the  APA  presentation  b/  Bunderson  (1970)  tn-t, 
at  lt«st  for  the  cUm  of  ta*ka  and  aptitudes  studied  in  this  project,  a 
wore  fruitful  approach  would  bo  to  loox  at  single-step  regression  lines 
rather  than  to  soak  di  sard  Inal  interactions.  If  a  strong  regression  exists, 
ttie  instructional  designer  can  ask  himself  wy.  He  can  introduce  changes  in 
the  prograr  to  reduce  chat  in  forest  ion-  processing  )>urden  for  the  lot— *i  titu  ie 
individuals,  hopefully,  using  fete  infomation -i>r<jceesing  constructs  developed 
tlirough  the  rationale  described  in  Soction  ZtZ,  nc  can  select— DaseJ  on  tneory- 
instructional  variables  to  manipulate  during  revision.  Vhe  variables  he  intro¬ 
duces.  in  a  CAI  program  at  least,  night  oe  nicro- treatment  variables  sppliou 
adoptively  wit.iin  s  branching  CM  program  rat. «r  than  tiurough  t.a  j production 
of  an  entire  alternate  treatment  (Bunder son.  1969b) . 

Zt  was  also  suggested  tost  the  nicro- treatment  -tetnodology  and  tn-a 
analysis  of  rsgrtssion  patterns  for  single  treatxenti.  leau  uore  naturally  to 
an  optini^ation  lethodology  than  to  tne  methodology  of  regression  ar.alyois 
anJ  macro  treatments  described  aoovs.  Zn  tuis  a-mrotch,  aptitude  treasures 
uecome  parameters  in  optir.isation  r models  of  ->oue  type  (vnich  can  bo  applies 
dynan ically  wltnin  CM  [urograms) .  T.iis  thinking  four.*  noro  po'*crful  expression 
in  the  lsboratorj  research  scudie:,  which  ere  summarised  in  Section  III. 

Tue  formulation  of  new  information-  processing  constructs  relevant 
to  bo  tit  aptitude  tests  and  concopt- learning  tasks  discussed  uc  low  is  seen  as 
providing  tne  constructs  and  construct-validation  ^atiiodolojic^  p  mittiiv? 
the  develo|«icnt  of  matiiecatical  .typo  ttiesis 'Construction  l ode Is  of  concept 
learning.  If  this  evolving  approach  is  successful,  it  aiy  prove  to  *u*v.  tiio 
strengths  of  the  optini cation  approach  described  oy  At'.inson  (1970)  for  in¬ 
structions!  decision-making  and  learning  theory .  Hop.- full/,  it  mlg.it  also 
contributs  worn#  of  the  conceptual  rlchnuss  characteristic  of  tne  Guilford 
aptitudes  tradition  fron  w.tich  tills  project  is  an  intellectual  descendant. 

Zt  snould  oe  recognised  in  evaluating  tiio  findings  of  tills  research 
project  that  wo  nave  restricted  the  investigation  almost  exclusively  to  cog¬ 
nitive  aptitudes  and  to  concept  and  rule-learning  tasks.  Tlie  cm. jectfs  learn 
ing  process  for  these  tasks  occurs  over  s  reletively  snort  period  of  tine. 
Cronbacn  and  Snow  (1969)  stress  that  aisoruirtal  intsrsetions  s.ould  .<o  nought 
in  learning  situations  which  occur  over  a  longer  p.riou  of  time  sc  t..at 
subjects  can  necome  attunec  to  the  instructional  treat. ant-i.  bitter  long-term 
learning  situations  ana  by  using  noncognitive  as  well  as  cognitive  aptitudes, 
it  stay  be  possible  to  justify  tits  design  of  two  or  noro  macro- treatments  and 
to  assign  individuals  to  alternate  treatments  for  instructional  gain,  h  tas); 
for  the  future  is  to  apply  the  cvj tnodo logical  approach  ana  conceptual  models 
Joveloped  in  this  project  to  longer  term  loaminj  to  detarmine  whether  or  not 
it  might  lave  ths  sami  advantages  found  inro. 

Vne  paper  by  ..errlll  (1-71)  .-as  written  attar  !te  receiver  the 
doctor  of  philosophy  degree  and  iia*.  accepter  a  position  at  Florida  State 
university.  *'.t«  al„ori\.iB.ic  or  information-processing  analysis  procedure 
which  i.c  uoscribes  was  conceivoc  during  th  reriea  of  .'ienograua  studies, 
x>wover,  and  is  described  in  preliminary  form  in  Olivier  (1>70)  aiK.  .crrill 
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(1970).  The  informs  cion -processing  analysis  approach  .err  ill  describes  his 
its  counterpart  in  tne  methodology  u jscribeu  in  the  following  section  for 
laboratory  tasas.  .mrrill’o  pai*r  is  included  in  tils  report  to  complete 
an  important  conceptual  symmetry  between  the  parts  of  this  project  repre 
seated  in  Table  1. 

A  for  words  must  be  said  about  the  importance  of  the  instructional 
assign  nodel  (which  substantially  evolved  during  the  course  of  thin  project) 
to  developsents  of  national  significance  in  CAI .  nie  paper  entitled  Coo  rotor 
in  l  to  inline  Instruction  (Bundorson,  1970a)  laid  tho  foundation  for  an  Anproach 
to  tlie  introduction  of  cost-effective  CAZ  into  junior  colleges  end  other 
adult  education  institutions.  This  approach  has  found  expression  in  Major 
proposals  to  the  national  Science  Foundation  (iiSF)  submit  tcxi  cooperatively 
by  i3nc  Corporation  and  the  University  of  Texas  CAI  Laboratory.  These  pro¬ 
posals  aim  toward  the  development  and  introduction  of  low-coat,  oarhet-orlcntco 
systems  consisting  of  s  marriage  of  television  and  computer  tec  mo  logy  on  tho 
hardware  sloe  and  of  curricula  designed  according  to  the  instructional  design 
model  on  the  educational  side.  An  extension  of  tho  ioarr.or -control  research 
and  tho  instructional -design  research  initiated  in  tills  project  lias  foun 
continuing  support  through  a  five-year  grant  from  the  National  Science 
Foundation  for  research  in  instructional  design  and  authoring  systems 
(Grant  GJ  509  .<,  initiated  June,  1963) . 


SECTION 


XIX 


STUDIES  RELATED  TO  THE  USE  Of  LAbOK/TORY  TASKS 


A  cursory  gUnco  at  tno  list  of  studies  Appearing  under  the  heading 
laoeleu  XXX  in  Table  i  representative  of  the  larger  portion  of  effort  in 
this  project  does  not  convey  too  evolutionary  logic  and  interrelationsaipe 
which  ex  is  tea  aaong  tnese  seemingly  diverse  activities,  .he  studies  fall 
into  clusters,  lnuicetco  by  tiie  suatmedings  of  A  throug.i  E,  witn  Category  r 
representing  extensions  of  toe  basic  methodology  boyono  concept- learning 
tasks  and  cognitive  aptitudes,  v.iia  section  begins  with  s  general  overview 
of  ell  studies  listed  under  the  heading  laLelac  IXX  in  Table  1.  Subncadiiur* 
for  Categories  A  tnrough  P  tnen  designate  detailed  reports  and  interpreta¬ 
tions  of  the  various  studies. 

The  fund*)  iantal  loess  on  wruen  the  series  of  stuaies  was  based  are 
as  follows  ( hereinafter  designated  as  Propositions  1,  2,  anc  3) . 

(1)  Tne  most  critical  step  in  understanding  and  predicting 
complex  learning  behavior  comes  tnrough  a  careful  and  accurate  analysis 
of  efficiont  hunan  information-processing  strategies  for  that  class  of 
tasks. 


12)  Cognitive  aptitudes  relevant  to  performance  on  a  class  of 
tasks  may  be  selected,  ano  their  interactions  with  treatments  nay  bs 
understood  in  relation  to  their  relevance  to  the  infomat  ion-proems  in; 
requirements  of  the  task. 

(3)  Cxporinental  manipulations  of  task  variables  produce  affects 
on  task  performance  end  on  aptitude  interactions  understandable  from 
the  manner  end  oxtent  to  vnlch  tnese  manipulations  alter  t.iv  information 
processing  requirements  of  tiw  task. 

Tl»e  clustars  of  stuulee  dosignatoo  A  tliroug.i  F  un.ter  XXX  in  Tsbl  ?  1  can  bo 
placed  in  context  to  the  extent  tut  they  elucidated  one  or  more  of  the 
Propositions  1,  2,  or  3  in  relation  to  concept-learning  tasks  and  correspond¬ 
ing  cognitive  aptitudes. 

Clusters  A,  B,  and  C  were  concerned  /1th  r.ultiplc-category  con¬ 
junctive  concept  problems.  Such  problems  are  characterised  by  the  learning 
of  a  multiple  response  syjtem  to  tho  values  or  combinations  of  values  on  t)>e 
relevant  dimensions.  Prior  analysis  of  thin  pro-ilen  .aid  led  to  tho  defini¬ 
tion  of  two  decision  rules  w  iic.i  could  fora  t.io  basin  for  officiant  information 


13 


processing  strategics  in  solving  these  concept  problsns.  Studies  in  Category  B 
wore  concerned  /ith  the  effect  on  tasl:  performance  ana  aptitude  interactions 
of  manipulating  an  instructional  variable,  namely,  information  about  arc. 
practice  on  o>w  or  both  of  the  decision  ruler.  Tuey  relate  no  at  clearly  to 
Proposition  3,  ana  established  be  aouest  but  important  conclusion  that 
experimental  Manipulations  wnicn  produce  no  Mean  differences  say  nonetheless 
produce'  important  aiffcrences  in  aptitude  patterns. 

i'ue  second  of  these  studies  set  out  to  accomplisn  aoro  t:ian  the 
stateaent  implies  by  separating  tine  stages  of  learning  in  the  multiple  category 
task  and  providing  instruction  on  the  too  decision  rules  separately  for  dif¬ 
ferent  groups.  Baaed  on  this  detailed  analysis  of  tno  task,  predictions  were 
naua  relative  to  aptitude  Interactions.  The  complexity  of  the  results  inuicat©. 
that  further  definition  of  botn  the  information  processing  occurring  in  dif¬ 
ferent  instructional  treatments  and  of  the  aptitudes  was  necessary.  Recogni¬ 
tion  of  this  difficulty  was  influential  in  leading  to  the  methodological  inno¬ 
vations  of  the  studies  in  Category  0  a n*  the  theorotical  considerations  of 
Category  C. 

The  final  study  in  this  series  was  not  an  aptitude -treatment  inter¬ 
action  study.  It  relates  to  Propositions  1  ana  3  and  reflects  a  considerably 
advanced  understanding  of  the  interaction  between  the  strategy  (decision 
rules)  usee  by  learners  and  tno  sequence  of  concept  exemplars,  ‘the  role  of 
contiguity  in  concept  identification,  contrary  to  previous  literature,  was 
shown  to  be  deperwien*  on  the  learner  strategy,  while  it  -.'as  iiot  possible 
to  follow  up  the  ir.pl icst ions  of  tnis  study  to  thu  acre  instruction-oriented 
aspects  of  this  prograu,  the  implications  nay  be  worthy  of  serious  investiga¬ 
tion.  Tne  careful  shaping  of  the  structure  and  sequence  of  concept  exemplar.* 
based  on  theoretical  propositions  derived  fron  basic  research  and  applied  to 
information-processing  analyses  of  complex  school  learnii.g  tasks  may  become 
e  powerful  instructional  ueslgr.  technique  (e.g.,  Tennyson,  Uooley,  a  ilcrrill, 
1970) . 


The  study  in  Category  C  Turtnor  established  the  conclusion  that 
aptitude  interactions  may  exist  in  s.>ite  of  a  lack  of  s«an  differences  between 
treatment  groups  (Blaine  &  Donnaw,  1970) .  This  study  (Blaine  *  Dunham,  1971) 
showed  also  that  tho  relationship  of  memory  to  performance  coulu  be  manipulated 
by  varying  the  availability  of  previous  inutanevs,  although,  as  in  the  second 
study  under  Category  a,  the  relationships  aru  not  easily  interpretable.  Thia 
study  relates  to  botn  Propositions  2  and  3  and  to  the  Xunograde  study  discussed 
above  (Bunderson  &  Hansen,  1971) . 

The  series  of  studies  in  Category  A  of  III  in  Table  1  relates  most 
directly  to  Proposition  1  end  that  part  of  Proposition  3  concerned  with  tat/, 
performance  rather  than  aptitude  interactions.  Prior  experimental  work  anu 
analysis  of  the  uultiple-category  concept  proalcu  had  led  to  too  suggestion 
that  tne  re  may  be  two  steps  involved  in  the  solution  process  (Overstreet  6 
Dunham,  1969) .  These  two  stages  were  designated  as  dimension  selection  and 
associative  learning.  In  order  to  study  the  effects  of  task  manipulation  on 
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the  two  decision  rules  necessary  to  efficient  performance  in  problems  of  this 
type,  it  is  necessary  to  separate  experimentally  the  dimension  selection  and 
associative  learning  stages.  This  was  done  with  increasing  sophistication 
in  understanding  of  and  control  over  the  students'  use  of  these  decision  rules 
through  tne  series  of  studies  designed  under  Category  A.  In  Overstreet's 
dissertation  (1970)  the  implications  to  suthematical  models,  such  as  t  .at  of 
Chumbley  (1970),  and  to  the  model  developed  as  a  result  of  the  research  in 
Category  C  were  drawn. 

Although  not  employing  aptitude  measures,  these  studies  were  impor¬ 
tant  both  methodologically  and  conceptually  to  the  evaluation  of  tninking 
alout  the  aptitude  treatment  interaction  proble- .  The  oethodo logical  separation 
of  the  dimension  selection  and  the  associative  learning  stages  was  attempted 
in  tne  second  study  in  Category  A.  The  refi7>e*ent  of  thinking  about  t.ie  infor¬ 
mation  processes  involved  in  concept  learning  were  fundamental  to  certain  of  the 
.as thoco logical  innovations  in  tne  studies  in  Category  D  ana  were  helpful  toward 
the  representation  of  important  information-processing  constructs  in  nathonuti  • 
cal  model  form  (Category  b) . 

Activities  listed  under  Category  D  cai.e  tc  represent  the  most  impor¬ 
tant  conceptual  and  methodological  contribution  of  this  project  to  research 
and  theory  involving  aptitude  x  treatment  ^othouology.  Using  ti.e  increased 
sophistication  in  information-processing  analysis  of  concept-learning  tasks, 
stuuies  in  this  series  producer  a  variety  of  new  Measuring  instruments  for 
both  cognitive  abilities  ana  c.>ncept-l earning  problems,  including  non-specified 
dimension  problems  as  well  as  the  Multiple-category  problem.  ,,es  uning  tnat 
variance  in  performance  on  noth  roiovant  conventional  ability  tests  and  con¬ 
cept  learning  tasks  could  be  accounteu  for  oy  tno  jama  set  of  processing  con¬ 
structs,  studies  in  tills  series  set  out  positively  to  define  these  constructs 
through  «  new  butt.odo  logical  procedure  anc.  to  use  then  powerfully  in  studies 
which  integrate  all  tliree  of  tne  propositions  listed  above,  because  of  the  im¬ 
portance  of  tnese  concepts,  extra  space  is  given  to  t.ie:.,  in  tnis  report. 

Studies  of  tniu  type  can  yield  information  processing  constructs 
wnich  account  for  large  portions  of  variance  in  complex  concop c-learning 
problems,  snu  possess  construct  validity  relative  to  important  stages  and 
decision  strategies  in  concspt  learning.  Suc.i  constructs  aiui  their  operational 
linkages  to  data  are  prerequisite  to  the  aevclopment  of  mathematical  mooels 
of  complex  concept -luarning  behavior.  Tne  studies  listed  unuer  Category  L  do 
not  yet  relate  to  Proposition  2,  but  they  arc  in  the  mainstream  of  thinking 
on  this  project.  This  is  so  because  tuoy  lead  toward  the  incorporation  of 
the  information-process in j  constructs  developed  in  tne  project  at  large  in 
hypothesis-construction  rode  Is  of  concept  learning.  Such  models  will  require 
the  addition  of  paranoters  to  reprusent  the  aptitude  process  constructs  shown 
to  interact  inportantly  witn  alternate  treatments. 

Tne  two  dissertation  studies  lit,  tec  u.v.er  Category  f  extended  the 
process-analysis  aptitude  treatment  et.iouolog/  of  t  ils  project  in  two  new 
directions.  ost  ambitious  was  the  study  by  .tollen  (1S70) ,  v;..o  attempted 
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an  information-processing  analysis  of  learning  from  connected  discourse.  Tne 
position  of  adjunct  questions  was  the  task  variable  predicted  to  produce 
aptitude  interactions  with  different  memory  abilities.  Hollen  attempted  to 
develop  a  new  process  test  for  a  hypothesized  memory  process  and  ror  predicted 
changes  in  the  regression  of  performance  scores  on  two  memory  abilities  due 
to  the  influence  of  adjunct  questions  on  processing  requirements.  As  was 
the  case  in  most  of  our  early  Xenograde  and  concept  studies ,  tne  results  were 
not  wnolly  consistent  witn  the  predictions  nor  were  tney  easy  to  interpret. 

The  aptitude  x  treatment  interaction  problem  in  a  new  task  domain  seems 
tractable  only  through  a  difficult  sequence  of  iterations  between  detailed 
task  analysis,  construct  validation,  and  empirical  observation. 

The  dissertation  by  iieyers  (1971)  built  on  the  foundation  of  researen 
laid  here  on  the  multiple-category  concept  problem  and  examined  the  effect  of 
anxiety,  moderated  by  ego  involvement,  on  cognitive  aptitude  x  treatment 
interactions. 


ilultiple-Catagory  Conjunctive  Concept  Problems 

Multiple -category  conjunctive  concept  problems  are  cu&racterized 
by  the  learning  of  a  multiple-response  system  to  the  values  or  combinations 
of  values  on  the  relevant  dimensions.  Prior  experimental  v/ork  anu  analysis 
of  this  type  of  concept  problem  has  led  to  the  suggestion  t..at  there  may  be 
two  stages  involved  in  the  solution  process  (Overstreet  &  Dunnam,  1963) . 

First,  the  subject  must  determine  the  relevant  dimension  or  dimensions  of  the 
problem.  Once  the  relevant  dimensions  have  been  determined,  tiie  subject  must 
learn  the  responses  which  are  associated  v/ith  tne  different  values  displayed 
by  the  relevant  dimensions.  This  interpretation  suggests  that  different  abili¬ 
ties  might  be  related  to  the  respective  stages  of  tne  task.  Further,  treatment 
manipulations  nay  affect  the  relationship  of  abilities  to  performance  only  in 
terms  of  one  stage  of  the  solution  process. 

Experiments  were  conducted  to  investigate  the  stages  of  learning' 
interpretation  of  multiple-category  problems  (Overstreet  s  Dunham,  1970; 
Overstreet,  1970) .  These  experiments  employed  multiple-category  problems 
which  were  experimentally  separated  into  the  dimension-selection  and  response¬ 
learning  stages.  It  was  possible  to  specify  two  decision  rules  wnicn  subjects 
could  use  in  determining  the  appropriate  dimensions.  Doth  rules  necessi¬ 
tated  a  comparison  of  two  instances  and  differed  according  to  wnether  the 
comparison  instances  were  from  the  same  or  different  response  categories. 

In  one  study,  subjects  were  instructed  on  one  of  tne  two  rules 
and  tuen  received  problems  varying  in  the  number  of  irrelevant  dimensions 
and  tne  number  of  values  per  dimension.  Subjects  were  forced  to  solve  the 
dimension  selection  puase  by  using  rules  for  whici  they  had  been  instructed. 

One  of  the  rules  allows  only  the  elimination  of  pairwise  combinations  of 
dimensions  but  not  the  elimination  of  any  single  dimension.  The  other  rule 
permits  the  elimination  of  a  given  dimension  without  regard  to  any  pairwise 
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combination  it  has  with  any  other  dimension.  Tnus ,  an  interaction  was  predicted 
between  rule-type  and  number  of  irrelevant  dimensions  in  txie  dimension  selec¬ 
tion  phase.  On  tne  other  hand,  neither  of  these  variables  snould  affect  the 
response  learning  stage,  w.iile  the  number  of  values  per  dimension  should  have 
a  great  effect  on  response  learning  vorfomance.  This  outcome  v/as  predicted 
since  the  number  of  responses  tne  subject  must  learn  increases  as  the  number 
of  values  per  dimension  increases. 

A  total  of  137  subjects  from  introductory  psychology  classes  were 
run  individually.  Tne  concept  materials  were  presented  at  the  cathode  ray 
tubes  connected  to  the  1321  1500  system.  The  results  supported  the  hypotheses, 
indicating  not  only  that  stimulus  complexity  variables  differentially  affect 
performance  within  the  different  stages,  but  also  differentially  affect  the 
efficient  execution  of  information  processing  strategies. 

Procedural  problems  in  Experiment  I  made  it  possible  for  subjects 
to  reduce  one  information-processing  rule  to  an  art if actually  simpler  form. 
Experiment  II,  utilizing  a  modified  procedure,  was  undertaken  to  replicate 
the  previously-obtained  differential  difficulty  of  the  information-processi:..; 
rules  and  to  clarify  the  interaction  of  rule-type  and  number  of  irrelevant 
dimensions.  Each  subject  solved  two  problems  without  associative  learning. 

The  results  of  this  seconu  experiment  replicated  the  basic  relation 
between  type  of  rule  and  difficulty  which  had  been  obtained  in  Experiment  I. 

The  number  of  dimensions  by  rule-type  interaction  obtained  in  Experiment  I 
was  not  replicated  in  the  second  study,  suggesting  that  a  significant  pro¬ 
portion  of  the  subjects  in  the  across-category  rule  conditions  in  Experiment  I 
may  have  discovered  and  utilized  the  simplified  form  of  this  rule.  Mo  main 
effect  for  number  of  irrelevant  dimensions  was  obtained  in  this  second  experi¬ 
ment. 


The  results  of  these  studies  were  interpreted  as  casting  doubt  on 
the  appropriateness  of  the  sampling-process  assumptions  underlying  current 
hypothesis-testing  models  of  multiple-category  concept  attainment.  Speci¬ 
fically,  the  results  were  interpreted  as  suggesting  that  a  subject  who  is 
faced  with  an  error  tnat  infirms  his  hypothesis  may  be  able  to  compare  that 
hypothesis  with  the  currently  available  stimulus  and  its  feedback  to  derive 
information  which  would  allow  him  to  restrict  temporarily  the  pool  of  dimen¬ 
sion  pairs  from  which  he  will  sample. 

The  implications  of  this  restricted  sampling  assumption,  i;»  two 
forms,  were  investigated  with  regard  to  the  Chumbley  (1970)  model  o i  multiple- 
category  concept  attainment.  A  further  differentiation  of  Cnumoley ' s  aptitude 
interaction  state  into  two  states  corresponding  to  (1)  hypotheses  containing 
only  irrelevant  dimensions  and  (2)  hypotheses  containing  one  relevant  dimen¬ 
sion  was  suggested  to  account  for  the  results  of  these  studies. 
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Deoieion  Rules  and  Conoept  Learning 

In  addition  to  the  investigation  of  the  nature  of  the  multiple- 
category  problems,  several  studies  were  conducted  in  which  the  concern  was 
ti.a  relationship  of  cognitive  abilities  to  performance  on  such  tasks  under 
differing  treatment  conditions.  One  study  (Dunham  &  Bunder son,  1969)  was 
undertaken  to  determine  the  effect  of  instruction  on  the  dimension  selection 
rules  described  above  and  the  relationship  of  cognitive  abilities  to  concept¬ 
learning  performance.  One  hundred  thirty-six  students  from  an  Austin,  Texas, 
high  school  were  randomly  assigned  to  two  groups.  A  total  of  69  subjects 
received  instruction  on  the  use  of  the  dimension  selection  rules.  The  re¬ 
maining  67  subjects  received  instructions  on  the  nature  of  the  concept 
problem  but  were  not  given  the  additional  rule  inslruction.  All  were  then 
given  a  series  of  multiple-category  concept  problems. 

There  were  no  differences  in  mean  performance  across  problems  for 
the  two  groux>s.  However,  the  introduction  of  rule  instruction  did  alter  the 
role  of  the  abilities  in  the  solution  of  the  concept  problems.  The  perfor¬ 
mance  of  the  group  given  rule  instruction  was  highly  related  to  a  reasoning 
ability  while  the  performance  of  tnc  group  without  rule  instruction  was  highly 
related  to  an  associative  memory  ability.  Thus,  students  with  a  particular 
cognitive  ability  profile  were  successful  under  one  condition,  while  those  with 
a  different  profile  were  successful  under  the  otnor  condition. 

In  tiie  above  study,  it  could  not  be  determined  whether  the  lack  of 
mean  differences  was  due  to  the  inapplicability  of  the  rules  or  to  inadequate 
instruction  on  the  rules.  Consequently,  a  pilot  stuuy  was  conducted  to  deter¬ 
mine  whether  or  not  training  subjects  to  use  the  rules  would  facilitate  per¬ 
formance  in  a  subsequent  multiple-category  problem.  A  group  of  33  subjects 
received  instruction  on  the  use  of  the  rules  and  were  then  presented  with  a 
series  or  twining  problems.  Following  this,  tne  subjects  were  given  a  four- 
category  conjunctive  concept  problem.  A  second  group  of  32  subjects  did  not 
receive  the  instruction  ard  training  on  the  use  of  the  rulus  but  received 
the  same  four-category  pr-olein  as  the  training  group.  The  results  of  the  study 
indicate  that  training  on  the  rules  does  facilitate  subsequent  concept  per¬ 
formance. 


In  the  first  aptitude  x  treatment  interaction  concept  study,  two 
decision  rules  were  involved  in  the  rule  instruction.  Since  this  was  the 
case,  an  additional  study  (Dunham,  1969)  was  undertaken  to  determine  if  the 
use  of  one  of  the  rules  would  roquire  different  abilities  tlun  those  required 
by  the  othor.  The  subjects  were  63  undergraduates  from  introductory  educa¬ 
tional  psychology  classes  at  The  University  of  Texa9  at  Austin.  Instruction 
and  training  on  the  c inension  selection  rule  involving  a  comparison  of  two 
instances  from  the  same  category  wore  given  to  37  subjects.  The  remaining  31 
were  given  the  same  instruction  and  training  with  the  exception  that  it  was 
with  the  rule  involving  a  comparison  of  two  instances  from  different  cate¬ 
gories.  The  training  for  both  groups  involved  specially-constructed  problems 
which  could  only  be  solved  using  the  rule  for  w.,ich  the  group  was  instructed. 
Following  the  training  phase,  the  subjects  were  given  the  same  multiple- 
category  concept  problem. 
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The  results  indicate  that  the  rule  involving  a  comparison  of  two 
instances  from  the  same  category  is  the  easier  of  the  two  rules  when  subjects 
were  forced  to  use  a  particular  rule.  There  were  no  differences  in  mean 
performance  in  the  subsequent  concept  problem.  However,  there  were  differences 
in  the  relationship  of  abilities  to  performance  on  this  problem  for  tne  two 
groups.  Performance  in  tne  condition  with  instruction  on  comparison  of 
instances  from  the  same  category  was  substantially  related  to  a  reasoning 
ability,  v/hile  performance  in  the  other  condition  was  most  highly  related 
to  an  associative  memory  ability.  Thus,  the  use  of  the  two  decision  rules  were 
related  to  different  abilities. 

In  both  of  these  studies,  instruction  and/or  training  on  decision 
rules  relevant  to  attaining  solution  in  multiple-category  concept  problems 
did  not  effect  differences  in  mean  performance  but  did  affect  the  relation¬ 
ship  of  performance  to  cognitive  abilities.  The  treatments  in  these  cases 
probably  changed  the  information-processing  requirements  in  the  task  as 
reflected  by  the  differential  correlations  of  the  uependent  variable  with 
the  ability  measures.  This  would  imply  that  different  people,  as  repre¬ 
sented  by  different  ability  profiles,  './ou Id  succeed  unuer  the  different 
treatments.  Such  differences,  however,  could  balance  out  and  not  oe  de¬ 
tected  if  only  the  means  were  examined. 


Availability  of  Instances  and  Memory 

An  additional  study  (Blaine  &  Ounham,  1969)  was  executed  involving 
the  same  underlying  theme  as  the  above  studies.  It  has  consistently  been 
shown  that  providing  subjects  with  available  past  instances  facilitates  per¬ 
formance  in  concept- learning  problems.  This  effect  is  usually  interpreted 
as  due  to  a  reduction  in  the  memory  requirement  of  the  task.  If  this  is  the 
case,  the  introduction  of  available  past  instances  should  effect  a  reduction 
in  the  relationship  between  tests  of  short-term  meaory  abilities  and  per¬ 
formance  in  a  concept- learning  problem. 

Tiie  subjects  in  this  study  were  60  undergraduates  from  introductory 
educational  psychology  classes  at  The  University  of  Texas  at  Austin.  A 
battery  of  tests  of  short-term  memory  abilities  was  selected  from  Guilford's 
Structure-of-Intellect  model  (Guilford,  1967).  Tne  subjects  were  then  pre¬ 
sented  with  a  multiple-category  concept  problem,  30  of  whom  were  given  the 
problem  by  the  regular  metnod  of  anticipation,  while  the  remaining  30  were 
presented  the  same  problem  but  sucii  that  the  just  previous  instance  and  its 
feedback  were  always  available. 

There  were  no  differences  in  the  mean  performance  of  the  two  groups. 
This  result  appears  to  be  inconsistent  with  previous  research.  However, 
the  number  of  available  instances  employed  in  this  study  was  at  a  minimum, 
the  smallest  number  ever  used  in  such  investigations.  Although  there  was  no 
difference  in  performance  between  the  groups,  the  relationship  between  the 
short-term  memory  was  substantially  correlated  with  performance,  within 
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the  group  with  a  past  instance  available,  the  relationship  was  raouccc.  In 
fact,  only  one  test  retained  a  positive  relationship  with  performance.  Thi3 
test  has  been  shown  to  be  related  to  “cognition*1  ability  while  all  other 
tests  have  consistently  been  related  only  to  'memory"  ability.  Thus  the 
results  of  this  study  support  the  contention  that  making  past  instances 
available  reduces  the  uenory  roquireucr.t  of  twe  concept  tas...  In  addition, 
the  results  are  consistent  with  the  previous  studies  in  tnat  an  experimental 
treatment  which  does  not  effect  differences  in  u.ean  performance  can  alter  tnc 
role  of  cognitive  abilities  in  task  performance,  such  a  result  is  mace  mani¬ 
fest  only  by  an  examination  of  t.ie  covariability  of  the  dependent  variable  with 
measures  of  cognitive  anility. 


Process  Measures  for  Aptitude  and  Learning 

Given  the  limited  amount  of  research  that  has  been  conducted,  it 
may  not  be  possible  to  present  a  general,  integrated  approach  to  the  rcsoarc  ■ 
question  concerning  tho  role  of  individual  differences  in  concept  learning. 

What  is  possible  and  necessary  is  to  realize  some  of  the  problems  involved 
in  research  of  this  type  and  to  consider  different  avonues  of  investigation. 

It  appears  that  an  appropriate  place  to  begin  any  investigation  of 
the  relationships  between  abilities  and  concept  learning  would  be  an  analysis 
of  the  task  in  terms  of  the  processes  that  the  learner  must  execute  in  order 
to  attain  solution.  This  would  provide  not  only  an  understanding  of  the 
task  itself,  but  also  a  basis  for  determining  tho  ability  requirements  of 
the  task.  If  the  investigator  is  able  to  specify  what  processes  must  be 
executed,  he  should  know  what  abilities  would  be  relevant  to  performance  in 
a  learning  task.  He  can  then  design  treatment  options  whicn  are  most  likely 
to  be  instructionally  effective  or  psychologically  interesting,  depending  on 
his  objectives. 

Therefore,  analyzing  the  task  in  terms  of  the  processes  required 
of  subjects  to  attain  solution  of  tho  concept- learning  problems  snould  pro¬ 
vide  a  better  understanding  of  the  ability  requirements  of  t.i;  task.  One  study 
(Blaine,  1961)  was  designed  ana  execute^  using  a  sample  of  200  students  frea 
an  Austin,  Texas,  nigh  school.  For  this  study,  a  number  of  nev.-  tests  were 
developed  in  which  the  items  were  intended  to  require  the  subjects  to  execute 
a  process  wliich  would  be  required  in  tne  nul ti pie -category  problems  that  tho 
subjects  had  to  solve.  Aii  attes  t  wac  made,  on  the  basis  of  tho  analysis  of 
a  multiple-category  problem,  to  develop  tests  which  separately  assessed  all 
the  processes  required  for  solution  of  the  concept  problcns. 

The  experimental  materials  were  administered  in  tnree-hour  blocks 
on  each  of  three  consecutive  days.  The  first  day's  materials  consisted  of 
a  battery  of  known  ability  tests  which  arc  frctpicntly  u  .ed  in  testing  for 
individual  differences  in  learning  research.  On  the  second  day,  tho  subjects 
were  given  eight  multiple-category  concept  learning  problenr.  in  trfiich  measure 
of  both  dimension  selection  and  response  learning  were  obtained.  The  specially 
developeu  tests  were  administered  during  the  third  day's  cession. 
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The  kiK*n  teste  of  abilities  and  the  specially -developed  tests 
have  also  been  administered  to  a  Maple  of  undergraduate  college  students 
froa  introductory  educational  psyc.'ology  classes  at  Tim  university  of 
Texas  at  Austin.  The  two  batteries  of  tests  were  administered  in  two 
separate  sessions. 

Xt  was  assumed  that  the  data  froa  these  studies  would  provide 
information  which  is  highly  relevant  in  considering  individual  differences 
in  learning.  The  relationship  of  the  tests  constructed  to  assess  execu¬ 
tion  of  required  processes  to  performance  in  the  concept  problems  provides 
an  evaluation  of  the  analysis  of  the  solution  process  in  multiple-category 
concept  problems  t  Xt  was  also  assumed  that  the  interrelations  of  these 
tests  with  the  known  ability  tests  would  indicate  the  extent  to  which  the 
known  ability  tests  assess  the  execution  of  processes  required  by  a  speci¬ 
fic  concept  task. 

The  process  tests  predicted  performance  on  the  concept  problems 
ss  wsll  ss  the  aptitude  tests,  nore  importantly,  the  execution  of  this 
study  underscored  several  problems  which  have  given  rise  to  the  considera¬ 
tion  of  an  alternative  approach  to  the  study  of  Che  relationships  between 
cognitive  abilities  end  performance  on  concept  learning  problems. 

Knowing  whet  abilities  are  relevant  docs  not  necessarily  imply 
that  they  can  be  adequately  assessed.  Xf,  after  analysing  the  task  several 
Abilities  are  shown  to  os  relevant,  the  investigator  is  still  faced  with 
the  problem  of  assessing  an  individual  subject's  capacity  to  execute  the 
relevant  processus.  After  this  is  accomplished,  there  is  no  guarantee  that 
the  tests  of  known  cognitive  abilities  will  be  related  to  the  specific 
concept-learning  task.  Absence  of  this  relationship  may  be  the  case  if 
differences  exist  in  content  between  the  task  and  the  test  or  in  the  level 
at  which  the  ability  ie  asaaeaad.  'this  reasoning  could  lead  to  the  extreme 
of  having  e  unique  set  of  teats  for  every  possible  learning  task,  which  docs 
not  appear  to  bo  feasible  or  appropriate. 

Xt  seems  it  ie  necessary  to  ciarlfv  the  term  "relationship"  as  it 
ie  used  in  the  phrase  "the  relationship  between  abilities  and  concept 
learning."  Traditionally,  it  has  been  interpreted  to  mean  that  the  ability, 
as  measured  by  tests  of  known  abilities,  was  necessary  in  solving  concept- 
learning  problems.  Xf,  tor  example.  Ability  A  has  s  lesser  relationship  to 
e  concept-learning  problem  than  Ability  B,  it  would  imply  that  Ability  D  is 
utilised  nore  than  Ability  A  in  solving  the  task.  This  kind  of  interpre¬ 
tation  implies  that  known  tests  of  abilities  measure  single,  specifiable 
cognitive  processes  or  that  several  tests  of  the  same  ability  measure  the 
same  single,  specifiable  cognitive  process.  The  results  of  those  two 
studies  showed  that  this  is  not  the  case,  host  tests  commonly  used  to 
define  an  ability  factor  contain  several  specifiable  cognitive  processes. 
This  indicates  that  the  relationship  between  abilities  end  performance  on 
e  learning  task  may  partially,  be  e  function  of  the  similarity  of  the  cog¬ 
nitive  processes  employed  to  attain  solution  of  s  concept-learning  problem 
and  to  perform  adequately  on  an  ability  measure.  Allison  (i960)  interpre¬ 
ted  the  common  factors  in  measures  of  learning  and  of  aptitude  and  achieve¬ 
ment  as  being  dependent  upon  the  similarity  of  the  psychological  process.? 
end  the  contents  of  the  material  involved  in  the  various  learning  tasks  or 
references  variables. 
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Traditionally,  studies  of  abilities  and  learning  have  attempted 
to  establish  direct  relationships  between  these  two  domains  by  utilizing 
various  factor-analytical  techniques.  This  approach  has  the  disadvantage 
of,  in  many  cases,  not  establishing  clearly  the  relationship  between  abili¬ 
ties  and  learning.  An  alternative  approach  to  this  is  to  posit  the  existence 
of  a  third  flows  in  i  processes  coewon  to  both  learning  and  abilities.  Psy¬ 
chologically,  it  way  be  possible  to  conceive  of  the  ability  tests  as  being 
a  cowposit  of  swell  concept  learning  tasks.  This  is  true  of  Induction  and 
General  Reasoning  tests,  and  it  way  also  be  the  case,  in  general,  for  teats 
of  known  cognitive  abilities. 

The  wajor  difference  between  tests  of  abilities  and  concept¬ 
learning  tasks  appears  to  concern  the  feedback  weehanisw.  In  concept- 
learning  tasks,  feedback  is  usually  supplied,  whereas  in  ability  tests, 
the  feedback  weehanisw  is  generated  by  the  subject.  If, then,  ability  tests 
and  concept-learning  tasks  ore  both  similar  fonts  of  learning  tasks,  it 
would  seew  appropriate  to  exawine  their  relationship  by  examining  the 
processes  cowwon  to  both. 

If  a  process  dowain  could  be  established,  it  is  hypo  the  si  red  that 
it  would  consist  of  several  relevant  cognitive  processes  that  would  be  simi¬ 
lar  to  those  the  subject  must  execute  in  performance  on  both  concept-learning 
tasks  and  ability  tests.  The  advantages  of  working  with  process  measures 
would  bet  (1)  to  reduce  the  entire  single  dowain  of  ability  measures  to  a 
relatively  small  nuwber  of  cognitive  process  wvasures,  and  (2)  that  after 
having  established  this,  to  construct  models  of  a  mathematical  nature  that 
would  Incorporate  structures  similar  to  those  of  cognitive  processes.  If 
this  were  done,  it  would  allow  the  investigator  to  exawine  the  role  of  indi¬ 
vidual  difference  parameters  in  concept  learning. 

A  general  outline  is  proposed  to  explain  how  a  domain  of  cognitive 
processes  might  be  constructed,  and  the  cognitive  ability  of  Induction  is 
used  as  an  example.  If  several  measures  of  Induction  were  examined  with 
respect  to  the  processes  the  subject  must  perform  to  attain  an  adequate 
score  on  the  ability  measure,  several  specifiable  cognitive  processes  could 
be  isolated.  Different  measures  of  these  processes  could  then  be  constructed. 
These  measures  would  be  constructed  such  that  they  would  be  as  similar  as 
possible  to  the  original  ability  measure)  that  is,  tney  would  be  specific 
to  the  processes  relevant  to  that  original  ability  test  and  would  contain 
the  same  content  material. 

In  constructing  such  measures,  they  would  be  univocal  with  respect 
to  the  cognitive  processes  necessary  for  performance  on  the  ability  test. 

If  this  sasw  type  of  analysis  wore  undertaken  with  respect  to  the  concept- 
learning  task  to  be  used,  measures  of  processes  relevant  to  the  concept¬ 
learning  task  could  also  be  constructed.  If  these  new  measures  were  then 
factor-analysed,  the  resulting  factor  structure  would  be  an  indication  of 
the  process  coewon  to  the  Induction  ability  and  the  concept-learning  task. 

If  this  sswe  type  of  procedure  were  carried  out  with  respect  to  a  wide 
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range  of  ability  mb  as  ur  os  and  concept-learning  tasks,  it  would  then  be 
possible  to  establish  a  domain  of  cognitive  processes  that  are  coo iron  to 
both  abilities  and  concept-learning  tasks.  This  procedure  is  depicted 
schematically  in  Figure  1.  note  that  the  transitions  froa  the  known  ability 
tests  to  uni vocal  ability  process  tests  are  rational.  An  analytic  process 
Bust  be  employed  by  the  perceptive  and  experienced  experimenter.  The  same 
is  true  in  obtaining  the  univocal  process  oeasures  froa  the  learning  tasks. 
Here,  one  is  assisted  by  eapirical  confirmation,  such  as  the  series  of 
studios  previously  described  related  to  the  analysis  of  multiple-category 
problems  in  different  stages.  Experimental  manipulation  of  variables  effect¬ 
ing  hypothesised  information  processing  by  subjects  is  a  powerful  technique 
to  aid  the  search  for  construct  validity. 

While  obtaining  uni vocal  process  aca3ures,  primarily  by  rational 
analysis,  one  is  assisted  in  his  search  for  process  constructs  common  to 
both  domains  by  tne  technique  of  factor  analysis.  Dimensions  thus  obtained 
can  bo  used  in  experimental  studies  in  the  sue  way  that  conventional  apti- 
tudo  measures  are  new  used  but  with  greater  expectation  of  interpretation 
and  goneraliseable  results. 

Pursuant  with  the  logic  in  Figure  1,  studies  were  undertaken  to 
examine  the  relationship  between  abilities  and  performance  on  conccpt-loarnirg 
tasks  in  terns  of  the  similar  cognitive  processes  involved  (Oostollo  & 

Dunham,  1971»  Costello,  1971).  When  multiple  treatment  groups  are  employed 
instead  of  a  single  treatment  group,  the  relationship  between  an  ability 
and  performance  within  any  treatment  condition  may  be  considered  a  function 
of  an  increase  or  decrease  by  treatment  manipulation  in  the  similarity  between 
cognitive  processes  measured  by  that  ability  and  those  cognitive  processes 
necessary  to  solve  the  concept  tasks.  In  essence,  a  treatment  manipulation 
defines  what  processes  relevant  to  solution  of  the  concept  tasks  in  that 
condition  are  involved.  Given  the  restraings  imposed  by  the  treatment  mani  ¬ 
pulation,  the  relationship  between  abilities  and  performance  is  a  reflection 
of  how  well  ability  tests  measure  cognitive  processes  similar  to  those  in¬ 
volved  in  concept  learning. 

This  analysis  of  the  relationship  oetween  abilities  and  performance 
on  concept- learning  tasks  is  especially  useful  with  abilities  that  show 
strong  relationships  to  performance  undor  several  different  treatment  condi¬ 
tions.  If  an  ability  relates  strongly  to  performance  across  several  treat- 
ment  groups ,  it  does  not  necessarily  imply  that  the  relationship  is  the  same. 
The  ability  of  induction,  for  exanple,  has  been  shown  by  Dunham  and  bunder- 
son  (1969)  to  have  emerged  as  a  general  factor  and  to  contribute  strongly  to 
performance  under  two  different  conditions.  Traditionally,  this  would  o* 
interpreted  as  an  implication  that  induction  is  important  to  concept  learning. 
If  concept-learning  studies  are  considered  to  be  concerned  with  the  individ¬ 
uals  induction  of  the  rules  of  belonging  and  not  belonging,  it  ia  not  sur¬ 
prising  then  to  find  that  Induction  has  a  strong  relationship  to  performance 
under  different  conditions.  To  say  that  induction  and  concept-learning  are 
highly  related  provides  no  further  information  stout  their  relationship.  It 
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ability  tests.  oonoc\  t  learning  taeke. 


Figure  1 . --An  example  diagram  of  an  approach  for  the  investigation  of 
intellectual  processes  common  to  mental  ability  tests  and 
learning  tasks. 
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nay  be  possible  that  different  cognitive  processes,  as  acasured  by  complex 
tests  of  induction,  relate  differentially  to  performance  in  different 
treatment  conditions.  This  type  of  knowledge  would  increase  understanding 
concerning  the  relationship  of  induction  to  performance  on  concept-learning 

tasks. 


A  preliminary  study  was  undertaken  to  investigate  the  concept 
that  known  ability  tests  are  composed  of  specifiable  cognitive  processes. 
The  general  approach  was  to  examine  the  known  tests  tnat  define  a  specific 
ability,  with  respect  to  the  cognitive  processes  the  subject  oust  perform 
in  order  to  attain  an  adequate  score  on  that  ability.  In  a  study  roported 
in  Costello  and  Dunham  (1971) .  such  an  analysis  of  the  induction  factor 
was  undertaken. 

The  Trench  Kit  of  Reference  Tests  for  Cognitive  Factors  define:, 
induction  primarily  bv  two  tests  t  Locations  Test  and  Letter  ssts.  with 
respect  to  the  cognitive  processes  that  the  subject  oust  perform,  prelimi¬ 
nary  analyses  of  these  two  tests  revealod  three  hypothesised  cognitive 
processes!  hypothesis  generation,  evaluation,  and  memory  for  generated 
hypotheses.  Two  measures  for  each  of  the  processes  were  constructed. 

The  subjects  were  75  undergraduates  from  introductory  educational 
psychology  classes  at  The  University  of  Texas  at  Austin.  The  battery  of 
cognitive  tests  was  selected  from  the  Kit  of  Reference  Tests  for  Cognitive 
Factors  and  from  Guilford's  Structure-of-Intcllect  Model  (Guilford.  1967). 
In  addition,  all  subjects  weru  administered  two  tests  for  each  of  the 
hypothesised  cognitive  processes t  hypothesis  generation,  evaluation,  and 
memory. 


The  factor  analysis  revealed  three  factors  which  coincided  with 
the  hypothesised  cognitive  processes  of  evaluation,  hypothesis  generation, 
and  memory.  The  high  multiple  R's  for  the  induction  tests,  using  only  t)v 
factor  scores  as  predictors,  seam  to  imply  that  the  hypothesised  cognitive 
processes  mey,  in  feet,  adequately  describe  the  processes  needed  to  account 
Cor  performance  on  tests  such  as  Letter  Sets  and  Locations.  Measures  for 
mental  abilities,  such  as  General  Reasoning,  Associative  Memory,  and  Flexi¬ 
bility  of  Closure,  were  included  to  determine  whether  measures  of  cognitive 
processes  would  have  a  relationship  with  tests  other  than  those  of  induc¬ 
tion.  The  multiple  R's  for  these  measures,  althougn  generally  not  as  high 
as  those  for  induction,  suggest  that  other  mental  ability  tests  mey  also 
have  specifiable  component  processes. 

The  two  tests  from  Cull ford's  structure-of-Xntellect  Model  ere 
tests  of  cognition  for  semantic  classes  end  of  divergent  production  of 
semantic  classes.  Tits  multiple  R's  for  these  tests  also  imply  that  indi¬ 
vidual  variation  on  ability  tests  may  be,  in  part,  a  function  of  individual 
differences,  witn  respect  to  some  specifiable  cognitive  processes. 
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A  preliminary  investigation  of  this  type  is  not  offered  as  con¬ 
clusive  evidence  that  abilities  are  composed  of  specifiable  cognitive 
processes.  Xt  does,  however,  suggest  that  across  a  diverso  r.mgo  of  mental 
abilities,  there  is  a  substantial  relationship  between  abilities  and  measures 
of  cognitive  processes.  This  then  implies  that,  in  studying  the  relationship 
between  abilities  and  performance  on  concept-learning  tasks,  it  may  be  un¬ 
necessary  to  achiinistsr  large  batteries  of  ability  tests.  Rather  than  be¬ 
havior  being  described  by  s  battery  of  ability  tests,  it  may  be  adequately 
described  by  s  few  measures  of  cognitive  processes.  If  this  is  the  case, 
then  abilities  could  be  understood  in  terms  of  their  component  cognitive 
processes,  and  theories  of  concept  learning  could  oe  formulated  describing 
performance  as  s  function  of  several  cognitive  processes.  This  would  then 
allow  the  investigation  of  individual  difference  parameters  within  s  concci  t- 
leaming  model. 

Xn  most  studios  involving  concept- learning  tasks,  the  dimensions 
of  the  task  are  specified  to  the  subject.  TSUs  has  the  effect  of  limiting 
the  number  of  posslolo  hypotheses  with  which  suojects  must  deal.  If  such 
studies  are  concerned  with  the  processes  relevant  to  the  induction  of  a 
class  concept,  then  limiting  the  ntmfcer  of  possible  hypotheses  lessens  the 
role  of  processes  necessary  to  the  generation  of  hypotheses.  In  the  study 
reported  by  Dunncm  and  Costello  (1971),  the  concept-learning  task  was  con¬ 
structed  such  that  the  dimensions  were  not  previously  specified  end  there¬ 
fore  would  not  restrict  the  number  of  possible  hypotheses. 

These  concept-learning  problem  can  be  solved  by  forming  hypothe¬ 
ses  with  respect  to  other  instances  of  the  concept.  The  subjects  first 
must  form  and  then  oust  use  these  hypotheses  to  attain  the  correct  concept. 

Xt  was  hypothesised  that  different  experimental  treatment  manipulations, 
such  as  the  availability  of  possible  hypotheses,  would  alter  the  relation¬ 
ship  oe tween  performance  on  the  concept-learning  problems  and  the  cognitive 
process  msasures. 

Measures  for  the  three  hypothesised  cognitive  abilities,  along 
with  eight  concept  problems,  were  administered  to  118  subjects  who  woro 
students  at  The  University  of  Texas  at  Austin.  The  subjects  were  randomly 
assigned  to  two  groups  (1)  Relevant  hypotheses  were  provided  for  the  first 
four  concept  problems  (hypothesis -supplied) ,  and  (2)  no  such  provision  was 
mads  (no -hypothesis  supplied) .  Instructing  s  group  of  subjects  to  use 
hypotheses  relevant  to  attaining  solutions  in  a  series  of  concept  problems 
did  contribute  significantly  to  their  mean  performance  when  compared  to  a 
group  that  was  not  given  the  hypotheses. 

Xt  was  hypothesised  that  the  availability  of  possible  hypotheses 
should  both  minimise  the  role  of  tne  cognitive  ability  of  hypothesis  genera¬ 
tion  end  should  place  s  greeter  emphasis  on  the  role  of  evaluation  of  the 
given  hypothesis.  Zn  the  no-hypo thesis  supplied  condition,  the  subjects 
exist  generate  their  own  hypotheses  about  the  nature  of  the  solution,  thereby 
placing  s  greater  importance  on  the  cognitive  ability  of  hypothesis  generation. 
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The  results  suggest  that  subjects  attaining  solution  in  one  of 
the  two  conditions  had  different  cognitive  ability  profiles.  This  was 
supported  by  the  discriminant  analysis  of  subjects  who  attained  solution 
in  both  conditions.  Therefore,  it  seems  apparent  that  the  manipulation  of 
availability  of  hypotheses  resulted  in  a  change  in  the  nature  of  the 
information  processing  which  occurred  in  the  two  groups.  This  change  then 
became  manifest  in  the  relationships  of  performance  to  process  measures. 

The  advantage  of  using  constructs,  such  as  hypothesis  generation 
and  evaluation,  as  cognitive  abilities  is  that  they  allow  the  researcher 
better  understanding  concerning  which  cognitive  processes  are  involved  in 
well-established  measures  of  abilities,  such  as  induction.  This,  in  turn, 
provides  a  vehicle  for  interpreting  the  relationships  between  known  cogni¬ 
tive  abilities  and  performance  on  learning  tasks.  Previous  studies  of  this 
type  have  shown  induction  to  emerge  as  a  general  factor  and  probably  to 
be  more  indicative  of  s <m  overall  level  of  performance.  Also,  in  most 
studies  of  abilities  and  their  relationships  to  learning,  induction  has 
been  shown  to  have  a  strong  relationship  to  different  treatment  groups 
within  the  same  experiment.  Unfortunately,  this  has  forced  researchers  to 
pay  attention  to  abilities  that  exhibit  weaker  relationships  to  learning 
when  these  relationships  vaz f  between  treatment  groups. 


Toward  a  Hyjwtheeio  Construction  Model  of  Concept  Identification 

Most  we 11 -developed  theories  of  concept  learning  have  dealt  with 
the  simplest  of  concopt  problems.  In  particular,  the  mathematical  theories 
have  primarily  been  concerned  with  the  two-category  unidimensional  problems. 
These  problems  are  quite  easy  for  human  subjects,  thus  placing  little  demand 
on  intellectual  abilities.  Since  the  theories  have  been  quite  successful 
with  simple  problems,  an  effort  was  undertaken  to  expand  these  theories  in 
order  to  describe  the  performance  in  more  complex  concept-learning  situations. 
In  these  situations,  it  was  felt  that  there  would  be  more  demand  on  the 
cognitive  apparatus  of  the  subject,  and  individual  differences  would  have  to 
be  taken  into  consideration.  The  assumption  here  is  that  as  theories  of 
simple  learning  are  expanded  to  more  complex  problems,  learning  must  be 
expressed  as  a  function  of  individual  difference  parameters  representing 
human  abilities. 

The  first  effort  in  this  direction  concerned  a  definition  for 
which  typo  of  theory  was  more  relevant  to  describing  more  complex  concept 
learning.  Information-processing  theories  of  problem  solving  may  be 
divided  into  two  classes.  (1)  The  first  assumes  that  subjects  enumerate 
all  possible  solutions  and  then  use  a  set  of  procedures  to  find  the  correct 
solution.  (2)  The  second  assisies  that  subjects  employ  a  set  of  processes 
(heuristics)  to  construct  possible  solutions  to  the  problem  by  basing  their 
solutions  on  the  kind  and  amount  of  information  available  at  that  time.  The 
subjoct  then  evaluates  the  adequacy  of  the  tentative  solutions. 
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Poison  and  Dunham  (1970)  classified  theories  of  concept  learning 
along  these  lines  into  hypothesis-sampling  models  and  hypothesis-construc¬ 
tion  models.  They  demonstrated  that,  as  the  number  of  values  on  a  dimension 
increases,  a  hypothesis  construction  theory  is  necessary  to  explain  the 
data. 


The  next  effort  related  to  theories  of  concept  learning  in  this 
vein  concerned  the  development  of  a  hypothesis  construction  (HC)  theory.  A 
tentative  version  of  an  HC  model,  developed  by  Reeve,  Poison,  and  Dunham 
(1970) ,  makes  the  following  assumptions  about  the  learning  of  unidimens iona.l 
multiple-category  concept  problems: 

(1)  On  the  initial  trial,  and  on  any  other  trial  where  he 
resamples,  the  subject  selects  from  the  set  of  all  dimensions,  a  subset 
of  dimensions  to  which  he  attends.  As  in  the  Trabasso  and  Bower  (1968) 
theory,  the  selection  mechanism  is  assumed  to  be  a  random-sampling  process 
in  which  the  probability  of  sampling  any  dimension  is  a  function  of  the 
salience  of  the  dimension. 

(2)  All  values  of  the  sampled  dimension  are  summed  not  to  be 
conditioned  immediately  following  sampling.  On  the  trial  in  which  sampling 
occurred,  or  on  any  other  trial,  the  feedback  is  conditioned  with  probability 
6  to  all  current  unconditioned  values  of  the  attended-to  dimensions. 

Trabasso  and  Bower  (1968,  Chap.  2)  assume  that  the  subject  alter¬ 
nates  between  a  search  mode  and  a  test  mode  of  operation.  In  the  search 
model,  the  subject  selects  a  set  of  hypotheses  consistent  with  current 
feedback.  The  subject  then  shifts  to  a  test  mode  for  the  next  stimulus  in 
the  series.  In  the  multiple-category  problem,  this  distinction  cannot  be 
sharply  defined.  Rather  them  sampling  hypotheses,  the  subject  samples 
dimensions  and  then  constructs  hypotheses  consistent  with  the  feedback 
given  with  each  instance.  He  may  have  the  opportunity  to  test  the  partial 
hypothesis  prior  to  completely  specifying  it. 

On  any  trial,  the  subject  is  confronted  with  a  complex  and  possibly 
conflicting  stimulus  pattern  to  which  to  respond.  The  value  of  each  of  the 
sampled  dimensions  may  be  conditioned  to  any  of  the  n  responses,  or  it  may 
be  unconditioned..  Consistent  with  Trabasso  and  Bower  (1968),  the  response 
rule  to  be  assumed  is  as  follows:  When  presented  with  a  situation  where 
all  values  are  conditioned  to  a  common  response,  the  subject  mkes  the 
response.  In  any  other  situation,  one  value  is  picked  at  randca,  and  the 
subject  makes  the  response  associated  with  the  sampled  value.  If  that  value 
is  unconditioned,  the  subject  guesses  with  each  of  the  responses  having 
equal  probability  of  occurring. 

The  final  process  is  for  eliminating  dimensions  from  the  focus 
sample.  Again  following  Trabasso  (1968),  it  is  assumed  that  an  error  of 
commission  leads  the  subject  to  resample.  When  the  subject  is  responding 
for  a  reason  and  is  correct,  those  dimensions  whose  values  were  associated 
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with  incorrect  responses  are  eliminated  from  the  sample.  Trabasso  and 
Bower  did  not  have  to  deal  with  the  third  possible  outcome,  where  the  subject: 
guesses.  It  is  assumed  that  regardless  of  whether  or  not  he  guesses  cor** 
rectly,  the  action  is  the  same  as  when  the  subject  is  correct  for  a  reason. 
Those  dimensions  leading  to  an  error  of  commission  are  eliminated  from  the 
sample. 


The  HC  model  with  the  attentional  and  focusing  assumptions  can 
be  summarized  briefly  as  follows:  (1)  The  subjects  current  state  is 
characterized  by  his  current  sample  and  the  response  (if  any)  associated 
to  each  value  of  each  dimension  of  his  sample.  (2)  The  subject  changes 
state  by  associating  responses  to  values  previously  unconditioned,  eliminat¬ 
ing  dimensions  from  the  sample,  or  resampling.  (3)  When  one  or  more  uncon¬ 
ditioned  values  are  presented  with  feedback,  the  feedback  is  conditioned 
to  these  values  with  probability  9.  (4)  When  the  subject  makes  an  error  of 

commission,  he  resamples.  A  sample  of  dimensions  is  chosen,  with  replace¬ 
ment,  from  the  set  of  all  dimensions.  Tne  probability  of  choosing  any  dimen¬ 
sion  is  a  function  of  its  salience.  (5)  When  the  subject  makes  a  correct 
response  or  is  guessing,  dimensions  having  values  conditioned  to  an  incor¬ 
rect  response  are  dropped  from  the  sample.  (6)  On  any  trial,  the  probability 
of  each  response  is  proportional  to  the  number  of  values  conditioned  to  that 
response.  Any  unconditioned  value  is  assumed  to  contribute  equally  to  the 
probability  of  each  ii  responses. 

Preliminary  testing  of  this  model  appears  in  Reeve  (1971).  A 
refined  and  more  explicit  version  of  the  above  summary  may  be  found  in  this 
report . 


(3)  A  third  effort  concerned  transfer  within  this  theoretical 
frame.  The  models  discussed  are  information-processing  models.  Instruc¬ 
tion  effects  are  of  central  importance  for  information  processing  models  of 
transfer.  Poison  and  Dunham  (1970)  investigated  the  effects  of  instruc¬ 
tions  within  a  variety  of  concept-learning  transfer  paradigms.  They  con¬ 
cluded  that  transfer  performance  is  a  function  of  instructions  at  the  transfer 
point  and  of  the  instructions  prior  to  original  learning,  as  well  as  the  type 
of  transfer  paradigm.  They  conclude  that  information  processing  models  assume 
that  transfer  performance  is  determined  by  the  type  of  information  processing 
strategies  that  the  subject  employs  during  the  initial  trials  of  tne  trans¬ 
fer  task.  The  strategies  that  tne  subject  uses  are  determined  by  the  nature 
of  the  transition  (i.e.,  the  type  of  transfer  paradigm)  and  the  information 
that  the  subject  has  about  the  relationship  between  the  two  problems.  In¬ 
structions  can  modify  the  utilization  of  these  strategies,  and  thus  instruc¬ 
tions  and  transfer  paradigm  may  b*  equally  powerful  determiners  of  transfer 
performance.  This  claim  follows  from  any  genural  information  processing 
theory  of  problem  solving.  These  theories  assume  that  the  subject  uses 
some  subset  of  a  larger  collection  of  information  processing  strategies  to 
find  a  solution  to  a  problem.  Furthermore,  v/e  cannot  assume  that  the 
subject  will  use  a  fixed  set  of  strategies  to  solve  a  given  class  of  problems. 
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Tne  effects  of  nonspecific  transfer,  instructions,  and  pretraining  imply 
tnat  these  variables  cause  qualitative  differences  in  performance  and  that 
the  subject  changes  the  set  of  currently  active  strategies  as  a  function 
of  experience  and/or  additions!  information  about  the  task. 


Extensions  of  the  Methodology 

A  study  was  undertaken  (Hollen,  1*70)  to  investigate  the 
roles  of  selected  cognitive  auilities  in  obtaining  information  from  passage, 
of  prose  materials  when  the  presence  and  position  of  adjunct  questions 
were  varied.  Predictions  were  made  that  the  associative  memory  ability  and 
a  postulated  chunking  memory  ability  would  be  related  to  task  performance 
as  measured  by  posttests  of  retention  of  information. 

Ability  measures,  task  materials,  and  a  posttest  of  retention  wern 
administered  to  136  subjects  from  introductory  classes  at  Sul  Ross  University 
under  three  treatment  conditions:  (1)  an  adjunct  question  preceding  each 
passage,  (2)  an  adjunct  question  following  each  passage,  and  (3)  no  adjunct 
question.  After  random  assignment  to  treatment  groups,  the  subjects  were 
further  divided  into  groups  for  wnom  English  was  a  primary  language  and  for 
whom  it  was  an  acquired  language. 

Results  indicated  that  only  tne  associative  memory  ability  was 
needed  for  task  performance.  A  reduction  in  need  for  tne  ability  in  both 
tasks  occurred  w.ien  questions  fol lowed  passages;  no  reduction  occurred  when 
questions  precoded  passages . 

Uisordinal  interactions  of  treatments  with  associative  memory 
observed  in  this  study  imply  that  in  the  absence  of  adjunct  questions, 
subjects  adopted  strategies  of  information  processing  maximizing  the  need 
for  associative  memory,  but  they  changed  to  strategies  minimizing  this  need 
when  questions  followed  passages.  The  change  in  strategies  was  more  appro¬ 
priate  to  task  performance  for  subjects  low  in  the  ability,  less  appropriate 
for  subjects  high  in  the  anility. 

Questions  were  raised  as  to  the  generality  of  findings  from 
previous  studies  concerning  the  facilitative  effects  of  adjunct  questions. 
Performance  of  subjects  high  in  associative  memory  was  actually  impaired 
by  the  use  of  adjunct  questions.  A  basis  for  future  investigations  was 
provided  by  data  from  subjects  for  whom  English  was  an  acquired  language. 
Results  suggest  the  possibility  that  such  subjects  adopt  information-processing 
strategies  that  differ  from  those  adopted  by  subjects  for  whom  English  is  a 
primary  language. 

During  the  term  of  this  program  of  research,  a  number  of  studies 
were  designed  to  assess  the  relationship  between  cognitive  abilities  and 
performance  on  various  learning  tasks.  It  was  repeatedly  shown  that  observed 
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relationships  between  cognitive  abilities  and  performance  vary  under  dif¬ 
ferent  experimental  treatments.  Another  study  (.ieyers  &  Dunham,  1971) 
was  undertaken  to  attempt  to  broaden  the  ability  by  treatment  interaction 
paradigm  through  the  examination  of  anxiety  and  task  involvement  as  they 
contribute  to  the  relationship  between  abilities  and  performance . 

There  were  four  experimental  conditions,  defined  by  all  combina¬ 
tions  of  two  types  of  concept  transfer  conditions,  and  two  types  of  ego- 
involvement  instructions  (nigh  ego-involvement  ana  law  ego-involvement) . 

All  subjects  received  two  consecutive  unidimensional,  four-category  concept 
problems.  The  second  problem  served  as  the  transfer  problem.  Tne  two  tran. - 
fer  conditions  were  extradimens ional  snifts  which  differed  as  to  whether 
the  dimensions  and  values  of  the  transfer  problem  were  the  same  (EDS)  as 
those  in  the  original  learning  problem  or  if  tney  consisted  of  new  (EDN) 
dimensions  and  values.  Consequently,  it  was  expected  that,  because  of  nega¬ 
tive  transfer,  the  EDS  problem  would  involve  competing  responses,  and  thus 
anxiety  would  have  a  relatively  debilitating  effect. 

Tne  subjects  were  188  introductory  educational  psychology  students 
at  The  University  of  Texas  at  Austin.  Tney  wore  first  administered  a  battery 
of  ability  tests  from  the  French  tCit  of  inference  Tests. 

Cnange  scores  (i.e.,  number  of  trials  to  criterion  on  original 
learning  problems;  number  of  trials  to  criterion  on  transfer  learning  problems) 
were  employed  as  the  dependent  measure  to  assess  transfer.  An  analysis  of 
variance  was  used  to  assess  tne  effects  of  transfer  and  involvement  condi¬ 
tions.  The  major  findings  for  this  analysis  were  that  the  EDS  shift  was 
significantly  more  difficult  than  the  EDil  shift  and  that  there  was  no  signifi¬ 
cant  difference  in  the  performance  of  subjects  between  high  and  low  involve¬ 
ment  instructions. 

A  regression  analysis  was  completed  in  order  to  assess  the  inter¬ 
active  effects  of  anxiety  and  abilities  on  perf ormance .  Although  it  was 
reported  above  that  there  were  no  significant  differences  in  performance  based 
on  "involvement  instructions,"  the  significant  interactions  with  anxiety 
and  ability  variables  occurred  only  with  low  involvement.  Under  this  condi¬ 
tion,  there  was  a  significant  interaction  between  anxiety  and  memory  span 
for  both  the  EDS  and  EDN  condition.  Moreover,  the  relationship  between 
anxiety  and  performance  was  relatively  debilitating  in  the  EDS  when  compared 
to  the  EDN  problem. 

The  major  finding  of  this  study  was  the  interaction  between  anxiety 
and  memory  span,  which  occurred  despite  the  lack  of  correlation  between  these 
two  variables.  This  finding  implies  that  anxiety  inhibits  the  utilization 
of  the  memory-span  attitude,  and  it  provides  support  for  the  notion  that 
not  only  treatment  conditions  but  also  personality  and  motivational  factors 
should  be  considered  within  tne  aptitude  jy  treatment  interaction  paradigm. 
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SECTION 


I  V 

EVALUATION  AND  CONCLUSIONS 


The  stragegy  on  which  this  project  was  based  was  reviewed  in  toe 
first  section  of  this  report.  It  attempts  to  develop  a  continuum  oetween 
research,  theory,  and  metitodology  in  the  psychological  investigation  of 
complex  human  learning  and  applied  curriculum  development,  primarily  for 


CAI.  This  continuum  can  be  represented  as 

follows: 

Body  of 

Psychological 

Research, 

Concept  Xenograde 

Design 

Applied  CAI 

llethodology,  +■* 

Learning  **♦  CAI 

itodel 

■*-+  Curriculum 

ft  Theory 

Laboratory  Program 

Development 

(Human 

Tasks 

Learning) 

Substantive  matters  within  tne  three  middle  categories  have  dean  reviewed 
within  the  body  of  this  report.  The  purposo  of  the  present  section  is  to 
evaluate  the  extent  to  which  the  transitions  between  the  areas  represented 
above  occurred.  These  transitions  are  represented  by  arrows. 

Between  the  Ixx.y  of  psychological  knowledge  in  concept  learning 
and  our  laboratory  studies,  the  distance  is  snort,  and  the  integration 
thorough.  Guided  by  Propositions  1,  2,  and  3,  discussed  earlier  in 
Section  III,  we  nave  produced  steady,  and  hopefully  useful,  increments  in 
empirical  data,  methodology,  and  cneory.  Most  contril  utions  have  neon 
dependent  on  the  detailed  information-processing  analysis  of  concept-learning 
tasks,  which  is  the  hallmark  of  our  methodology .  This  provides  a  rational 
approach  to  the  identification  and  interpretation  of  relevant  aptitudes  and 
their  interactions.  It  also  provides  a  route  to  the  construction  of  powerful 
and  useful  hypothetical  constructs.  Tae  combination  of  treatment  manipula¬ 
tion  and  aptitude  covariation  is  a  useful  methodology  for  establishing  con¬ 
struct  validity.  It  is  far  stronger  than  procedures  which  limit  themselves 
to  the  aptitude  or  experimental  domain  exclusively. 

In  our  estimation,  the  most  important  methodological  and  conceptual 
contribution  of  this  project  is  the  "process  measure"  approach  described 
in  Section  III.  Not  only  does  this  provide  a  methodology  for  aptitude  x 
treatment  studies  which  promises  to  be  clearer  conceptually,  but  it  may 
prove  to  be  an  important  step  toward  the  formulation  and  evaluation  of 
hypothesis-construction  theories  of  complex  human  learning— theories  which 
incorporate  ability  parameters  representative  of  constructs  having  a  separate 
source  of  empirical  construct  validation. 
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Mill*  important  initial  steps  toward  tills  goal  wave  ac..levu«! 
during  the  course  of  this  brief  project,  considerable  work  renal  ns  to  be 
done  before  the  "process  Measure  *  approach  is  adequately  evaluated.  The 
actual  extent  of  its  iaportancc  Bust  be  established  by  considerably  nore 
research  and  nore  theoretical  development. 

The  transition  between  the  laboratory  research  and  the  xenoqro',i 
research  fell  short  of  expectations  at  the  operational  level.  It  cannot  :  c 
said  that  cross  •validation  of  results  between  the  two  classes  of  learning 
tasks  occurred  in  any  important  way.  This  was  true  even  in  the  simple  cl  > 
of  the  role  of  naaory  ability  as  influenced  by  the  availability  of  previ 
examples. 

The  first  problea  obstructing  operational  cross-validation  lien 
in  the  fact,  observed  by  Glaser  11968) ,  that  laboratory  studies  of  concc 
learning  almost  exluslvely  use  an  inductive  approach.  Glaser  notes t  "It 
seems  contradictory  that  in  psychological  experiments  we  have  been  study!  ; 
just  the  types  of  concepts  that  might  beat  be  teught  by  presenting  the  ru'  i 
first." 


Zn  addition  to  the  inductive  emphasis  in  psychological  research, 
the  sequences  of  examples  are  usually  random  or.  at  best,  arbitrary.  In 
Xenograde,  the  most  i ns true tionsily -effective  treatment  used  an  explicit 
rule-example  presentation  to  establish  the  various  relational  concepts  vV'ch 
comprise  the  Xenograde  hierarchy.  Sequence  wee  shown  to  be  e  powerful  . 
fluence  on  performance.  This  method  wee  far  more  efficient  end  sometimes 
superior  in  teems  of  poettest,  retention,  end  transfer  than  the  inductive 
(discovery)  approach  using  examples  only.  Zn  this  efficient  treatment,  1 1  i 
relationship  of  aptitudes  to  performance  wee  greatly  reduced  or  eliminate^ 
altogether. 

The  factors  of  rule  instruction  end  sequence  were  not  entirely 
ignored  in  our  laboratory  research.  Decision  ruin  instruction  played  an 
important  role  in  the  studies  discussed  in  Section  ZZZ.  The  relationship 
between  sequence  effects  end  performance,  when  strategies  using  different 
decision  rules  ere  considered,  wee  also  studied  by  Blaine  end  Dunham  (1970) . 
Houses**,  it  cannot  be  said  that  the  most  streightfowerd  end  efficient  in¬ 
structional  design  was  ever  used  in  these  tasks. 

Zn  one  sense,  the  leek  of  clear  cross -validation  between  laboratory 
and  Xenograde  aptitude  x  treatment  studies  can  be  viewed  as  e  "success  stcry 
Proa  the  instruction  design  point  of  view,  we  have  learned  how  to  reduce  or 
to  remove  the  constraint  on  learning  associated  with  low  scores  on  certain 
aptitude  teste.  This  is  done  in  an  efficient  manner  through  the  use  of  rule 
example  sequences  ordered  in  accord  with  e  cumulative  hierarchy.  If  labo~a~ 
tory  concept-learning  studies  would  use  these  techniques,  it  would  have  at 
least  two  noticeable  effects,  first,  a  certain  body  of  research  end  theory 
would  be  shown  to  be  irrelevant  to  human  instruction.  Zt  would  prove  to  be 
an  artifact  of  keeping  subjects  in  the  dark.  Second,  e  relatively  untillod 
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area  In  hi— n  ooocept  learning  would  begin  to  bo  exploited.  Sources  of 
variance,  rwuialay  of  tor  complete  and  thorough  instructional  doslgn  ia 
applied,  —y  prow*  to  bo  oa  lntoroatlng  or  ooro  intoroating  than  tbo  do  pen¬ 
dant  variables  now  studied  in  concept  learning.  Conversely,  the  theory 
behind  the  effectiveness  of  these  instructional  manipulations  could  be 
developed.  Such  research  would  lead  toward  a  psychology  of  instruction  as 
contrasted  to  a  psychology  of  learning. 

An  evaluation  of  this  project  does  not  reveal  that  operational 
transfer  of  results  between  tightly  controlled  laboratory  research  and 
research  using  complax  instructional  teaks  cannot  be  accoaplishsd— only  that 
it  had  not  been  accomplished  in  a  convincing  manner  by  the  end  of  this 
particular  contract.  On  the  other  hand,  important  transfer  at  a  conceptual 
and  methodological  level  did  occur.  Information-processing  analyses  were 
applied  on  both  Xenograde  and  concept  probleaw.  Learning  Xenograde  can  be 
characterised  as  the  acquisition  of  a  complex,  conditional,  relational  con¬ 
cept.  This  concept  can  be  represented  as  a  set  of  10  decision  rules  which 
must  be  applied  in  a  certain  sequence,  these  rules  and  their  sequence  were 
obtained  by  a  new  task -analysis  procedure  which  is  ganerallxable.  The 
information-processing  task-analysis  procedure  developed  in  the  Xenograde 
studies  may  prove  to  be  a  worthwhile  contribution  to  the  learning  hierarchy 
literature. 


An  attempt  was  cade  to  develop  new  “process  measure"  tests  in  the 
Xenograde  studies.  However,  the  new  Xenograde  tests  did  not  seem  to  measure 
true  processes  as  defined  in  Section  HI.  Possible  exceptions  are  the  “chunk¬ 
ing  memory"  process  tests  developed  by  Hollen  (1970)  (which  were  not  a  notable 
success  in  achieving  construct  validity)  and  perhaps  Merrill 's  (1970)  memory 
test.  Merrill’s  new  tests  for  reasoning  seemed  to  be  parallel  forms  of 
traditional  Induction  and  Reasoning  tests  expressed  in  the  stimulus  materials 
and,  to  some  extent,  the  complex  processes  implied  by  Xenograde  riles.  The 
simpler  processes  of  hypothesis  generation  and  evaluation  dtvekfsd  by 
Costello  end  IXmhem  (1971)  are  more  representative  of  the  moaning  implied 
by  the  term  "process  measures,"  as  used  here. 

In  moving  now  to  a  consideration  of  the  transfer  of  Xenograde 
results  to  the  instructional  design  model,  it  must  be  said  that  the  initial 
model  for  use  of  aptitude  x  treatment  results  did  not  transfer.  As  dis¬ 
cussed  in  Section  II,  the  notion  of  locating  dle&rdinal  interactives  and 
using  test  scores  to  branch  to  two  or  mors  alternate  macro-treatments  was 
not  seen  as  promising.  Our  data  do  not  provide  a  justification  for  general¬ 
isation  of  this  conclusion  beyond  the  uso  of  short-term  concept,  rule -learning 
tasks,  and  cognitive  aptitudes,  although  thin  conclusion  may  be  more  general. 

Again,  at  the  methodological  and  conceptual  level,  important  trans¬ 
fer  did  occur  between  the  Xenograde  studies  and  the  instructional  designer's 
needs.  The  in formation -processing  task-analysis  procedure  is  now  a  part  of 
applied  curriculum  development  efforts  in  this  laboratory.  The  knowledge 
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that  aptitude  constraints  can  ba  removed  or  reduced  by  clear  rule-example 
presentation  and  >y  the  use  of  objectives  has  been  translated  into  mb*  Chi 
conputer  progress,  techniques  of  learner  control  over  sequence  and  display 
variables  have  been  incorporated  into  scan  CAX  progress  and  are  being 
evaluated  (Judd,  Bunderson,  a  Be seen t,  1970). 

the  instructional  design  nodal  has  evolved  substantially  during 
the  course  of  this  research  prog  ran.  there  is  a  good  natch  between  the 
design  products  and  possibilities  for  eaperinental  nan  1  pula tl on  in  the 
Xenograde  progress  and  the  categories  of  the  instructional  design  nodal, 
on  the  negative  side,  the  ineg inary  nature  of  Xenograde  nas  limited  the 
generality  of  results  obtained  through  use  of  this  task.  Sous  students  are 
not  interested  in  learning  an  imaginary  science.  I  loss  vac,  since  sons  stu¬ 
dents  are  not  interested  in  learning  anything  difficult,  we  are  not  sure  how 
far  our  results  have  been  biased. 

Originally,  the  imaginary  c'taracter  of  Xenograde  was  felt  to  be 
useful  experimentally  since  it  provided  control  over  prior  learning,  he  so 
often  proves  to  be  tbs  case  in  research,  its  greatest  value  was  not  related 
to  this  supposed  purity  from  prior  knowledge.  Prior  experience  with  quanti¬ 
tative  rules,  numerical  tables,  and  "scientific  thinking"  was  not  controlled 
by  the  unfamiliar  content.  Hie  great  utility  of  the  imaginary  task  proved 
to  be  in  freeing  the  experimenter-instructional  designers  from  concern  about 
related  scholarship,  teaching  traditions,  etc.  Xt  thus  bscwm  possible  to 
concentrate  on  questions  of  task  structure,  sequence,  and  display  without 
being  constrained  by  o titer  concerns,  when  some  characteristic  of  the  task 
hindered  experimental  objectives  or  efficient  instruction,  the  laws  of  the 
"science*  could  be  changed. 

Another  advantage  of  Xenograde  was  the  conscious  attempt  to  link 
the  Xenograde  program  to  the  reel  tactical  needa  of  the  instructional  designs 
this  pKogc«a>  wee  designed  following  the  guidelines  laid  down  by  the  model.. 

Xt  thus  underwent  extensive  revisions  on  the  beats  of  feedback  from  students 
in  the  early  studies » 

The  Importance  of  revision  baaed  on  student  feedbecx  cannot  be 
over  stressed.  As  discussed  in  Section  XX,  the  gain  in  instructional  effec¬ 
tiveness  due  to  revision  may  bo  greater  then  the  gain  possible  as  the  result 
of  brandling  to  an  alternate  treatment  based  on  an  aptitude  score.  The  samo 
statement  may  be  made  of  an  instructional  decision  based  on  any  other  proposl 
tion. 


Xn  evaluating  the  transfer  between  the  Xenograde  studies  and  the 
instructional  design  model,  it  must  be  stated  that  the  impact  of  formative 
evaluation  and  revision  on, the  Relevance  of  research  had  not' been  fully  per¬ 
ceived.  Xf  research  on  complex  tasks  does  take  piece  before  these  tasks  are 
thoroughly  tested  and  revised,  it  may  be  in  v^ln  insofar  as  relevance  is 
concerned.  On  the  other  hand,  if  researchers  fully  comprehend  the  decision 
processes  of  an  Instructional  designer  who  is  faced  with  data  which  indicates 
the  need  for  revision,  they  may  be  able  to  develop  and  validate  instructional 
theorems  which  ren  guide  the  revision  process. 
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Xt  mm  not  too  purpose  of  this  research  to  contribute  directly  to 
the  transfer  between  the  instructional  deeign  nodel  end  applied  curriculun 
devslopmsnt.  In  the  present  project,  tne  instructional  deeign  nodel  stands 
m  e  representational  echene  to  describe  an  "engineering  discipline"  for 
education.  Xt  is  focused  primarily  at  the  engineering  of  high  quality  CM 
propane.  Xn  order  to  couplets  this  discussion,  sons  thing  shooM  nonethe¬ 
less  be  said  concerning  the  effectiveness  of  the  nodel  in  guiding  equality 
curriculun  development.  The  enpirieal  proof  of  this  particular  "pudding" 
canes  through  the  evaluation  of  the  CM  pro  grans  generated  by  following  the 
nodel  (with  a  large  dash  of  tMte  and  creativity  thrown  in  to  noderate  its 
otherwise  nsdhanlcal  prescriptions).  The  results  ere  Host  promising!  Among 
other  topics,  the  model  hM  been  successfully  applied  to  freelmwua  »a the¬ 
se  tics  (Judd,  Bundencon,  a  See  sent,  1970),  freshman  English,  compote  r  science 
(Momeyer,  1970),  freaQman  chemistry,  end  the  Arabic  writing  systasi  (Abbood, 
1970).  Xn  tbs  esse  of  the  Arabic  program,  the  evaluation  results  ere  ss  much 
or  more  e  vindication  of  the  instructional  design  nodal  ss  of  CM.  Abbood 's 
instructional  design  thoroughly  restructures  the  current  pedagogical  pro¬ 
cedures  for  the  Arabic  writing  system  in  e  manner  only  partially  dependant 
on  s  CM  iaplementatlon .  An  evaluation  study  hM  revealed  that  classroom 
instruction  extending  over  six  weeks,  six  hours  per  week,  in  Arabic  can  be 
replaced  by  from  five  to  ten  hours  at  the  CM  terminal.  Contrary  to  class¬ 
room  instruction,  attrition  rate  is  very  low  or  nonexistent.  Attitudes  axe 
very  positive,  performance  scores  see  significantly  higher  then  in  classroom 
instruction,  end  apparent  transfer  to  later  classroom  work  is  greater. 

Xn  conclusion,  this  section  hM  attempted  to  evaluate  the  feasibil¬ 
ity  of  s  strategy  which  seriously  tried  to  provide  e  series  of  links  between 
practical  questions  of  instructional  design  end  e  science  of  human  learning. 
The  conclusions  of  this  evaluation  can  be  siaesarlsed  in  terms  of  two  rubrics  > 
operational  cross-validation  and  metaphorical  transfer. 

At  the  level  oi  operational  cross-validation  between  laboratory 
tasks  and  inatxuctlonally-oriented  tasks,  this  strategy  did  not  succeed 
during  the  two  years  allotted  to  this  project.  There  is  no  evidence  that  it 
cannot  succeed,  if  given  more  time,  given  e  conscious  recognition  of  the 
difficulty  of  the  endeavor,  and  given  e  recognition  of  the  possibility  that 
the  method:,  paradigms,  and  models  of  psychological  research  can  be  nodified 
to  be  mrre  relevant  to  instructional  theory. 

to  be  more  relevant  to  instruction,  the  rsychologlcal  study  of 
concept  learning  could  incorporate  the  following  suggestions » 

(1)  Xt  should  investigate  behavior  under  expository  m  well  ss 
inductive  presentations.  Complex  and  cumulative  sequences  of  concepts  should 
be  investigated. 

(2)  Xt  should  consider  more  carefully  seeslngly  microscopic 
sequence  effects  between  adjacent  concept  exeaplars.  Stated  alternately,  it 
should  investigate  the  manner  of  constructing  adjacent  and  near-adjacent 
examples  and  non-examples  to  taka  advantage  of  design  strategies. 
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(3)  Oo^tltlvi  aptitude  oonrliblM  should  be  incorporated  in 
experimental  designs,  but  as  "process  measures"*  rather  than  strictly  in  the 
form  of  more  traditional  tests.  In  computer-based  research,  apt!  tods  a  nay 
be  measured  on-line  and  as  s  subtle  part  of  learning  activities  themselves. 

In  CM,  aptitude  par—eters  should  be  related  to  micro  adaptive  mechanisms 
(i.e. ,  control  over  sequence  parens  ten1  st  display  parameters)  rather  than 

as  the  basis  for  branching  to  alternate  macro- treatments  (alternate  programs) . 
Aptitude  x  aptitude  x  treatment  interactions  should  be  studied  as  mail  as  the 
case  with  single  aptitudes. 

(4)  Aesearch  should  take  into  account  the  payoff  from  an  instruc¬ 
tional  decision  relative  to  the  payoff  from  revision  of  the  learning  task. 
Whether  based  on  an  individual  aptitude  parameter  or  an  implied  group  mean 
difference,  an  instructional  decision  nay  produce  a  less  significant  effect 
than  revision.  Revision  may  be  lees  costly  than  the  research,  or  it  may 
alleviate  the  need  for  the  decision.  Improvement  through  revision  may  be 
due  to  a  series  of  minor  nodif lcations ,  made  at  points  where  feedback  from 
students  has  revealed  deficiencies,  or  it  may  be  based  on  a  restructuring 

of  an  important  variable  which  runs  throughout  the  treatment. 

A  corollary  to  this  last  guideline  is  that  tasks  used  in  human 
learning  research  sitould  reach  an  asymptote  in  effectiveness  produced 
through  formative  evaluation  and  revision  before  lavishing  the  money,  time, 
and  talent  of  a  research  eetablisisaent  on  them. 

At  the  level  of  metaphorical  transfer  of  the  procedures,  tactics, 
and  conceptual  approaches,  the  project  rates  more  highly.  Some  Important 
idaas  which  reverberated  throughout  all  aspects  of  the  project  are  the  ideas 
of  information-processing  task  analysis,  "process  measures"  for  aptitudes, 
end  aptitudes  as  parsmef  rs  having  independent  construct  validity.  In  addi¬ 
tion  to  these  instances  of  positive  transfer,  the  strategy  permitted  the 
identification  of  exactly  share  transfer  wee  hindered,  due  to  different 
emphasis  or  procedures  in  laboratory  and  instructional  research. 
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task,  1971. 

Tech  7  Blaino,  u.  0.,  6  Dunham,  J.  L.  Strategy  instruction  and  type  of 
sequence  in  concept  attainment,  1971. 

Tech  0  Overstreet,  J.  D.  The  roles  of  stimulus  complexity  and  information 
processing  rules  within  two  phases  of  multiple-category 
attainment,  1971. 
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tne  relationenip  of  memory  abilities  to  performance  in 
multiple-category  concept  tasks,  1971. 

Tech  10  Dunham,  J.  L. ,  6  Poison,  P.  G.  Tneories  of  unidimensional  concept 
identification,  1971. 

Tuch  11  .'layers,  J.,  a  Dunham,  J.  L.  mi  investigation  of  the  effects  of 
anxiety,  abilities,  and  tas*  characteristics  on  concept 
learning,  1971. 
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Teen  12  Dunham,  J.  L.,  &  Blaine,  D.  D.  The  relationship  of  abilities  to 
different  stages  of  concept  attainment,  1971. 

Tech  13  Dunham,  J.  L. ,  &  Costello,  R.  J.  Intellectual  processes  in 
concept  learning,  1971. 

Tech  14  Poison,  P.  G.,  Dunham,  J.  L.,  &  Reeve,  fi.  6.  Effects  of  instruc 
tions  on  performance  in  three  shift  paradigms,  1971. 


Technical  demos 


Systems  demo  1  Smith,  A.,  Wheaton,  A.,  Gregory,  C.,  S  Bunderson,  C.  V. 

..  Cc,arse\n:iter  II  function  (fcalc)  for  the  manipula¬ 
tion  of  numerical  and  algebraic  expressions,  1970. 
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category  concept  problems.  Journal  of  Educational  Psychology,  1969, 
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the  Conference  on  Computers  in  the  Undergraduate  Curricula.  Sponsored 
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In  progress. 
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Olivier,  W.  P.  Program  sequence  by  ability  interaction  in  learning  a 
hierarchical  task  ay  computer  -assisted  instruction,  1970. 
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instructional  designer?  Paper  presented  at  the  annual  meeting  of  the 
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Bunderson,  C.  V.  Aptitude  by  treatment  interactions:  old  problems,  new  ap¬ 
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September,  1970. 
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Table  1 


Summary  of  Research  Conducted  Wholly  or  Partially  Under  ARPA  Contract 


Study  or  Activity  Code*  Products  Completed 


I.  Studies  Related  to  Use  of  Xenograde  Program 

A.  Discovery  vs.  Expository  Treatments 

— and  Simulation  FP  Discussed  in  Bunderson  (1971) 

— General  Reasoning,  Memory,  T3  Bunderson,  Merrill,  &  Olivier  (1971) 

Induction 

— Reasoning  and  Performance  Dis,  Merrill  (1970) 

Objectives  T5  Merrill  (1970) 

— Memory  and  Availability  T6,  Bunderson  &  Hansen  (1971) 

PS  Hansen. &  Bunderson  (1971) 

B.  Sequence  &  Learner  Control  Dis,  Olivier  (1970) 

T4  Olivier  (1971) 

II.  Instructional  Design  and  CAI 

A.  Instructional  Design  Implications 


— Design  and  Documentation 

PS 

Merrill  (1969) 

of  Xenograde  Program 

T2 

Bunderson  &  Merrill  (1971) 

— Aptitude  X  Treatment 

PS 

Bunderson  (AERA,  1969) 

Interactions  and 

PS 

Bunderson  (APA,  1969;  1970) 

Instructional  Design 

—Instructional  Design 

FP 

Bunderson  (1970.1,  1970b) 

Model 

— Algorithmic  Analysis  for 

Merrill  (1971) 

Learning  Hierarchies 
B.  Program  Documentation 

--Mathematical  Response  TM1  Smith  et  al.  (1970) 

Analysis  Function 

— Plot  Functions  TM2,  Wheaton  et  al.  (1970) 

PS  Wheaton  (ADIS,  1970) 

III .  Studies  Employing  Laboratory  Task3 

A.  Analysis  of  Learning  Stages  and  Decision  Rules 


Decision  Rules  G 

PS, 

Overstreet 

&  Dunham  (SWPA,  1970) 

Learning  Stages 

Dis, 

Overstreet 

(1970) 

TO 

Overstreet 

(1971) 
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Table  1  (continued) 


Study  or  Activity  Code  Products  Completed 


III.  B.  Decision  Rules  and  Concept  Learning  Identification 

--Decision  Rule  Instruction  Tl,  Dunham  &  Bunderson  (J.Ed.P.,  1969) 
and  Aptitudes  JA 

••-Decision  Rules,  Learning  PS,  Dunham  (AERA,  1969) 

Stages  &  Aptitudes  T12  Dunham  &  Blaine  (1971) 

—Sequence  Effects  &  PS,  Blaine  &  Dunham  (AERA,  1970) 

Decision  Rules  T7  Blaine  &  Dunham  (1971) 

C.  Availability  of  Instances  PS,  Blaine  &  Dunham  (AERA,  1969) 

&  Memory  JA,  Blaine  &  Dunham  (J.Ed.P.,  1971) 

T9  Blaine  &  Dunham  (1971) 

D.  Process  Measures  for  Aptitude  &  Learning 

— Relationship  of  Conceptual  Dis  Blaine  (1971) 

Task,  Test,  &  Process 
Measures 

— Intellectual  Processes  in  PS  Costello  &  Dunham  (AERA,  1971) 
Inductive  Reasoning  & 

Concept  Learning 

— Intellectual  Processes  in  T13,  Dunham  &  Costello  (1971) 

Concept  Learning  Dis  Costello  (1971) 

E.  Toward  A  Hypothesis  Construction  Model  of  Concept  Identification 


— Comparison  of  Two  Types 

PS, 

Poison 

£  Dunham 

(MPC,  1970) 

of  Theory 

T10 

Dunham 

&  Poison 

(1971) 

— Instructions  &  Transfer 

PS, 

Poison 

,  Dunham, 

&  Reeve  (MPA,  1970) 

in  Concept  Shift 

T14 

Poison 

,  Dunham, 

&  Reeve  (1971) 

— Theory  of  Multiple- 

Dis 

Reeve 

(1971) 

Category  Concept 

Identification 

F.  Related  Research 

— Adjunct  Questions  &  Memory 

Dis 

hollen 

(1970) 

— Anxiety  &  Aptitude 

PS, 

Meyers 

&  Dunham 

(AERA,  1971) 

Interaction 

Til, 

Meyers 

(1971) 

Dis 

Meyers 

(1971) 

*Code  Abbreviations:  Tn  =  Technical  Report  Number  ___ 

TM  =  Technical  Memo 
Dis  =  Dissertation 
JA  «*  Journal  Article 

J.Ed.P.  =  Journal  of  Educational  Psychology 
FP  =  Articles  in  Formal  Proceedings 

PS  =  Paper  Presented  at  Meeting  of  Professional  Society 
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